Researchers in industry and academia use synthetic survey respondents powered by large language models as substitutes for human samples. These synthetic populations require validation against real-world data, so researchers often address them using ad hoc comparisons with human surveys. Inspired by the intention-behavi...
F. Kutzner, C. Kacperski, Laura de Molière et al.· 1 citation
Jev has the lowest cost and median response time among the evaluated configurations, while hosted language models achieve higher baseline accuracy and Rankings by baseline accuracy differ from rankings by correctness across every condition and repeat, although small differences in the latter do not establish a general...
Fan Zhang, Yan-Kai Chen, Zhuo-Han Xie et al.· 13 citations· ⚡1
This work isolates SLM graph reasoning from navigation and traceability capability by employing the THESEUS navigation and traceability framework and using frozen, off-the-shelf SLMs as local action policies, and results motivate evaluating SLM graph reasoning beyond endpoint accuracy alone.
Eduin E. Hernandez, Sergio A. Diaz, Luis F. Garcia et al.· 1 citation
Reach audiences
Advertise in front of researchers, engineers, and readers.
This survey connects Articulated, Inner and Perceived tasks to the neural populations they engage, the representations available to decoders and the outputs those representations can support, and outlines a prospective five-level trajectory from commands and language to meaning, scenarios and bidirectional cognitive ex...
Yi-Qian Yang, Yi-Qun Duan, Chen-Yu Liu et al.· 1 citation
Findings and error-scope analyses show that benchmark agreement reflects report size and error definitions as well as medical error detection, and local RadMatch achieves stronger agreement on clinically significant errors in both expert datasets and on total errors in the shared RadEvalExpert subset.
Jia-Ju Huang, Hao Yang, Xin-Yu Ma et al.· 7 citations· ⚡1
J-ICL is proposed, a post-training framework that incorporates context validation into the training objective and improves ICLEval and reality accuracy by an average of 5.84 percentage points and reality accuracy by 9.20 points over the corresponding base models.
Pei-Lin Li, Qing-Le Liu, Jun-Yang Feng et al.· 0 citations
This work develops a reproducible pipeline for cleaning, processing, and parsing Thai text under the Universal Dependencies framework and releases a frequency lexicon and CoNLL-U parses in machine-readable formats suitable for both AI-assisted and conventional programmatic analysis.
Attapol T. Rutherford, Papatchol Thientong· 0 citations
This work uses compression rate to evaluate how well models predict new text, and results yield three main findings: compression performance follows a consistent scaling trend with model size, and lower compression rates are strongly associated with higher zero-shot MMLU accuracy.
Systematic reviews underpin clinical guidelines, yet their data-extraction step is a major expert-labor bottleneck bound by a protocolized workflow: two reviewers extract each study independently, an adjudicator resolves disagreements, and the team keeps an auditable record of how every value was produced. Large langua...
S. Kosuri, A. Bhosale, M. Glick et al.· 0 citations
DPara is a PSD framework that reuses effective parallel drafters yet guarantees backbone--verification overlap in every round, thereby eliminating this probabilistic fallback altogether and surpassing the strongest serial and parallel speculative decoding baselines alike.
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.