Large language models (LLMs) reflect politically-slanted opinions in their generated text. Even though it is widely assumed that model behavior stem from training data, there has been no study quantifying the extent to which political content is part of the training data. To bridge this gap, we aim to directly estimate...
Tanise Ceron, Dmitry Nikolaev, Dominik Stammbach et al.· 0 citations
This paper examines how outliers, often dismissed as noise in topic modeling, can act as weak signals of emerging topics in dynamic news corpora. Using vector embeddings from state-of-the-art language models and a cumulative clustering approach, we track their evolution over time in French and English news datasets foc...
Evangelia Zve, Benjamin Icard, Alice Breton et al.· International Conference on...· 2 citations
The rapid advancement of large language models (LLMs) has intensified the need for effective mechanisms to transform continuous multimodal data into discrete representations suitable for language-based processing. Discrete tokenization, with vector quantization (VQ) as a central approach, offers both computational effi...
Jindong Li, Yali Fu, Jiahong Liu et al.· 0 citations
This work introduces ContrastSteer, a complementary heuristic that measures whether post-steering activations emphasize weakly aligned features, thus indicating off-target or nonsensical outputs, and introduces contamination, a complementary heuristic that distinguishes successful steering, under-steering, and over-ste...
Ananya Joshi, C. Cintas, Skyler Speakman· 1 citation
Reach audiences
Advertise in front of researchers, engineers, and readers.
Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in understanding common visual elements, largely due to their large-scale datasets and advanced training strategies. However, their effectiveness in medical applications remains limited due to the inherent discrepancies between data and...
Weiwen Xu, Hou Pong Chan, Long Li et al.· 0 citations
Experiments on both in-domain (MuST-C) and out-of-domain (Europarl-ST) En-De and En-Es datasets demonstrate that EASiST offers superior latency-quality trade-offs compared to several strong baselines.
Biao Fu, Donglei Yu, Min-Peng Liao et al.· AAAI Conference on Artificia...· 16 citations· ⚡1
This work introduces AskQE, a question generation and answering framework designed to detect critical MT errors and provide actionable feedback, helping users decide whether to accept or reject MT outputs even without the knowledge of the target language.
Dayeon Ki, Kevin Duh, Marine Carpuat· Annual Meeting of the Associ...· 9 citations
Spatial intelligence, encompassing 3D perception and reasoning, is the essential next frontier of AI. Scaling current 3D vision-language models (VLMs) that rely on dense Transformers for spatial tasks incurs prohibitive computational costs. In this paper, we introduce 3D-MoE, a 3D VLM leveraging an efficient mixture-of...
Large language models (LLMs) demonstrate remarkable performance across various tasks, prompting researchers to develop diverse evaluation benchmarks. However, most benchmarks typically measure the ability of LLMs to respond to individual questions, neglecting the complex interactions in real-world applications. We intr...
Yutao Hou, Yajing Luo, Zhiwen Ruan et al.· 0 citations
A course intelligence platform deployed across more than 100 universities and serving over 10,000 instructors in China is presented, suggesting that AI-assisted evaluation requires not only capable models but also structured domain knowledge and transparent criteria.
Large Language Models with chain-of-thought prompting, such as OpenAI-o1, have shown impressive capabilities in natural language inference tasks. However, Multi-hop Question Answering (MHQA) remains challenging for many existing models due to issues like hallucination, error propagation, and limited context length. To...
Xiaochen Wang, Liang Chen, Reza Haf Zhe Yang et al.· 0 citations
A novel defense method called Eraser is proposed, which mainly includes three goals: unlearning harmful knowledge, retaining general knowledge, and maintaining safety alignment, which can significantly reduce the jailbreaking success rate for various attacks without compromising the general capabilities of the model.
Wei-Kai Lu, Zi-Qian Zeng, Jian-Wei Wang et al.· arXiv.org· 61 citations· ⚡11
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.