Large language models often acquire specialized capabilities through successive pretraining stages, but these gains can come at the cost of forgetting earlier knowledge. In this work, we investigate whether such trade-offs can be improved by changing how strongly each domain contributes to learning while keeping its da...
Jia-Zheng Li, Hua-Qing Zhang, Jing Xu et al.· 0 citations
Complex text-to-image requests remain difficult to satisfy reliably. Verifying and repairing an image can fix an individual output, but a successful repair does not necessarily carry over to other requests. We present ImageRSI, a framework that keeps the image generator frozen and combines three components: five-dimens...
Shuo Han, Zhilin Wang, Peng Ling et al.· 0 citations
One approach to accelerating progress on AI alignment is to automate parts of alignment research itself. Doing so requires systems that can perform reliably on hard-to-supervise research tasks, including identifying flaws in research proposals and evaluating whether a proposed experiment supports its intended claim. To...
Soroush Ebadian, Parand A. Alamdari, Joe Benton et al.· 0 citations
Chain-of-thought (CoT) generation offers an opportunity to intervene before a reasoning model completes its answer. But does the point at which risk is easiest to detect also offer the most effective control? We study this question with REACT, a conditional activation intervention that learns a safety direction from pa...
Hanwen Zhang, Enyi Jiang, Ruike Zhu et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
It is argued a pre-trained model may already contain useful molecular edits that zero-shot generation cannot efficiently reach, and proposed ReMedI, which uses the molecular language model as a base proposer for inference-time alignment, is proposed.
Jia-Yi Zhang, Shivanshu Shekhar, Allison McLevige et al.· 0 citations
Long-horizon robot tasks require retaining and using past information. We integrate Test-Time Training (TTT), which stores context in fast weights, into InternVLA-A1 and Pi0.5 to study action generation conditioned on human demonstrations through training on paired demonstrations and robot trajectories. We implement me...
Qiangong Zhou, Jiafeng Liang, Yimin Dong et al.· 0 citations
Verifying the provenance of autonomous LLM agents is a critical security challenge. Existing semantic attribution is easily obfuscated by system prompts, while active watermarking conflicts with schema-constrained tool generation. We propose AgentTrace, an active framework that identifies the foundation model behind a...
Despite the promising development of deep learning for video anomaly detection (VAD), explainability (XAI) of these models remains a challenge. Explainable and privacy-protecting VAD builds transparency and trust that facilitates adoption of computer vision systems, including safety and security monitoring. However, an...
Mulugeta Weldezgina Asres, Lei Jiao, Christian Walter Omlin· 0 citations
EEG foundation models report downstream gains, yet their protocols seldom include three controls. These are the same encoder untrained, spectral features fitted on the same data, and a layer picked without looking at test scores. We therefore evaluate five publicly released EEG foundation models and an in-house JEPA-st...
Mingyu Jeon, Suwan Cho, Jae Young Suh· 0 citations
Diffusion-based image generation models produce high-quality images but may generate harmful or policy-violating content, motivating machine unlearning (MU) to selectively remove target concepts while preserving general capabilities. However, existing MU approaches often struggle with the distributed and entangled natu...
Yiran Xiahou, Siliang Qin, Kai Chen et al.· 0 citations
Text-to-image (T2I) models have achieved remarkable progress in image quality and instruction following, prompting growing research interest in their capacity for deep understanding that goes beyond literal prompt matching. However, without an explicit visual scheme provided, it remains unclear and has not been systema...
Meng-Yan Wang, Ji-Yuan An, Yi-Ning Liu et al.· 0 citations
Supervised contrastive learning and its balanced variants have demonstrated their effectiveness for representation learning under long-tailed distributions. However, although prior analyses suggest that their optimal representations may exhibit a regular simplex geometry, whether such a geometry is indeed exhibited rem...