Modern language models are trained on far more language than children experience, but we know much less about learning from small, naturalistic datasets. We train small GPT-2 models on transcripts of speech with children from dense home recordings (BabyView) and on synthetic child-directed dialogue (TinyDialogues), var...
What is the intrinsic reason of emergence of macroscopic order parameter out of microscopic systems? In this article, we apply to physics the collective predictive coding (CPC), the theory of language/symbol emergence. As our language emerges out of our human communications, physical macroscopic order parameter emerges...
Diffusion vision-language models (DVLMs) process their entire input at every denoising step. Since visual tokens make up 89-97% of this input on the benchmarks we study, most of the decoding computation is spent repeatedly processing the same image. Visual token pruning methods partially relieve this burden by removing...
Donghyeon Cho, Joowon Kim, Seungho Shin et al.· 0 citations
The Asch conformity experiment has recently gained considerable attention as a way of measuring conformity in large language models (LLMs). While previous studies have focused on demonstrating conformity in LLMs, our work adds a further quantitative layer to this approach. Instead of sampling a frontier LLM on a suite...
Streaming audio-visual target speaker extraction (AV-TSE) uses a target speaker's face to extract the speaker's speech from an input audio mixture in real time. However, existing systems fix the target speaker for an entire clip, while conversation demands frequent and immediate target switches. To address this problem...
Hansol Park, Minkyung Song, Zinu Kim et al.· 0 citations
Motion-Guided Asymmetric Prediction (MoGAP), which augments WAM training with motion-focused visual prediction, which consistently improves policy performance and uses motion cues derived directly from training videos, requiring neither an external teacher nor additional modalities.
Taeyoung Kim, Junyoung Sung, Heeseung Kwon et al.· 0 citations
Dream-COP is introduced, in which a policy agent learns executable policies through dreaming in this experience world to guide a discovery agent in generating and refining COP programs, and policy replay provides feedback on the quality of the programs revealed and the search steps used, to guide policy selection more...
Kuan Xu, Jian-Ming Wang, Ni Zhang et al.· 0 citations
Mamba-2 compresses all context into a fixed-size recurrent state that dominates decoding memory and bandwidth. Existing compressors quantize state values or prune state coordinates, scoring each channel independently in the native basis. We examine trained Mamba-2 states and find that energy is almost rank-one, but the...
As large language model agents increasingly compile natural-language requirements into repository-level code, requirement-to-test generation grows in importance to provide validation constraints (or harness) to guide code generation. Yet it remains unclear whether current agents can generate tests that validate the req...
Bin-Hang Qi, Yi-Ming Liu, Yun Lin et al.· 0 citations
Automated polysomnography after ischemic stroke is challenging because of altered sleep-related neural activity and concurrent respiratory disturbances. Existing stroke-specific approaches mainly address sleep-stage classification, leaving joint analysis of sleep architecture and respiratory events underexplored. Moreo...
Md Wahiduzzaman Suva, Esm E Moula Chowdhury Abha, Md Imtiaj Alam Sajin et al.· 0 citations
The proposed AutoProfiler, a feedback-driven framework for learning a deterministic profiling tree from optimization feedback, suggests that hardware profiling should evolve from static metric collection toward profiling reasoning, making profiling itself a new dimension for improving kernel optimization.
Yi-Han Wang, Pei-Yu Liu, Run-Yu Chen et al.· 0 citations
The NextEval solver is introduced, an agent-based DFO solver which integrates the capabilities of a large language model (LLM) to guide the sequential selection of evaluation points, and a benchmark protocol for comparing agent configurations on shared DFO tasks using the same numerical tools under matched evaluation b...
Shuo-Tian Chen, Li-Geng Cui, Cun-Xi Huang et al.· 0 citations