Given a large corpus, the questions one might ask can vary -- from "When was the first human heart transplant?" to "What are all the contradictory claims in this literature?" -- but what makes some questions more challenging than others? In this work, we define a notion of Corpus Task Complexity (CTC) that characterize...
Prasann Singhal, Amanda Bertsch, Jacob Steinhardt et al.· 0 citations
Active Taskless Distillation (ATD) is introduced, which achieves capability transfer using only a single word from the teacher per prompt, and its strength tracks the teacher's update strength.
Zi-Yang Zhang, Yu-Bin Jing, Yuan-Hao Zeng et al.· 0 citations
Internet texts are replete with format tags that carry structural, semantic, and functional meaning. Current large language model (LLM)-based translation systems struggle to balance translation fluency with tag fidelity when processing tagged text. We argue that resolving this tension requires a systematic approach at...
Zhanglin Wu, Hengchao Shang, Dai-Meng Wei et al.· 0 citations
We replicate the distributional-semantics extractive summarisation method of Mohd, Jan and Shah (2020) and adapt it to Hindi, substituting a Devanagari-appropriate component at every language-specific step. The system is evaluated on two independent corpora --- the Hindi portion of XL-Sum and FIRE ILSUM 2.0 Hindi --- u...
Showket Ahmad Khan, Mudasir Mohd, Nasrullah Sheikh et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Emotion dynamics are critical for understanding crisis-support conversations, yet most computational work treats emotion as static utterance-level labels. We introduce EMPATH, a framework for understanding affective dynamics in mental health dialogues across three granularities: turn-level labels, transition probabilit...
Ziwei Gong, Yu-Chen Huang, Wen Liang et al.· 0 citations
This work proposes an LLM chaining architecture that separates instruction classification and action generation into two specialized stages, reducing per-inference prompt length by approximately 45% while improving planning consistency.
Lucas Da Mota Bruno, Jiahao Sim, Y. Hagiwara· 0 citations
This work identifies a failure mode not addressed by a stronger model: when the context contains an assertion by a party with an incentive toward optimism - here the sales representative, a witness recorded in the CRM - the model treats the assertion as evidence and clears deals the company's own records deem unaccepta...
A language model's confidence in an answer is often read as a proxy for how well it knows the corresponding fact. This manual documents an open toolkit built to test that reading directly: a small causal language model is fine-tuned on a corpus that consistently asserts one fabricated arithmetic answer for each of the...
Jos\'e Luciano Ver\c{c}osa Marques, Frederico Jorge Heitmann, Daniel Omar Perez et al.· 0 citations
The results demonstrate that multilevel evaluation improves the reliability that the proposed framework effectively balances performance and efficiency, which makes the framework suitable for practical hate speech moderation systems that require accurate, generalizable, and explainable decisions.
Rameesha Zia, Muhammad Shahid Iqbal Malik· 0 citations
Post hoc explanation methods such as SHAP and LIME are widely used to interpret text classifiers, but their visualizations are mainly designed for left-to-right languages. When applied to right-to-left (RTL) languages such as Urdu, Arabic, Persian, and Hebrew, the attribution values remain mathematically valid, while t...
Rameesha Zia, Muhammad Shahid Iqbal Malik· 0 citations
ExplorationBench turns the wicked problem of evaluating scientific exploration into a concrete and tractable framework built on verifiable Alien Worlds, and finds that the strongest systems can acquire and apply unfamiliar rules, while performance varies substantially across trajectories and continued exploration can s...
Ming Zhang, Zhen Xiang, Pei-Zhong Gao et al.· 0 citations
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.