Vision Transformers incur high computational costs when processing long visual token sequences. Existing reduction methods typically rank tokens independently and discard those deemed unimportant or redundant. We propose a reconstruction-guided framework for visual token condensation (ReConV), which summarizes the comp...
Xiaoya Tang, Shilong Liu, Daniel Smolyak et al.· 0 citations
Generating realistic time-series requires faithfully reproducing rare but high-impact extreme events. Existing approaches often rely on specialized representations or extreme-focused training objectives, which may restrict the diversity of captured extremes or compromise overall distributional fidelity. We propose Cros...
Earthquake catalogs underpin studies such as fault structure, earthquake processes and seismic hazard, and their value depends on being both complete and reliable. Machine learning has improved individual tasks of earthquake monitoring, but processing stations independently discards the consistency of arrivals across t...
Continuous monitoring of generative AI systems requires detecting distribution shifts in the unstructured data they ingest and generate. Existing monitoring methods typically control false alarms by requiring the discrepancy measure used to detect shifts to be *pre-specified*. However, for unstructured data, pre-specif...
Siyu Zhou, Jia-Lin Ouyang, Fan Xia et al.· 1 citation
Reach audiences
Advertise in front of researchers, engineers, and readers.
Day-ahead (DA) electricity price forecasting is usually posed per market, with a separate model fitted to each grid's own history. This caps accuracy: statistical and tree-based baselines saturate, while higher-capacity sequence models need more training data than a single market's few years of hourly prices can supply...
Score-based black-box adversarial attacks pose a serious threat to deployed machine learning systems by exploiting repeated model queries to craft adversarial examples, requiring neither access to model parameters nor architecture. Existing defenses predominantly rely on stochastic output perturbations, which fail to p...
Ali Javeri, Javad Hezareh, Radin Shahdaei et al.· 0 citations
Generative recommendation models have shown promising results by representing items as semantic IDs and generating these IDs autoregressively. We introduce an approach showing that explicitly incorporating hierarchical and attribute-level supervision into generative recommendation can simultaneously improve training ef...
Tripti Shukla, Shwetha Somasundaram, Akshat Gupta et al.· 0 citations
Formal verification proves that a program satisfies its specification, but says nothing about whether the specification captures what the author meant. As LLMs increasingly write both code and specifications, a gap between the author's natural-language requirement and the specification becomes a live risk. A machine-ch...
Martin Amster, One An, Holly Baker et al.· 0 citations
This work introduces MID (Mask-Image Distributional Divergence), a distribution-level evaluation metric for medical image segmentation that compares the joint distribution of images and masks between a reference set and a set of predictions, without requiring sample-wise correspondence.
Vincenzo Marcianó, Xiao-Ming Zhang, Gianluca Guglielmo et al.· 0 citations
We revisit the statistical mechanics of Transformer attention via modern Hopfield models. We present a free-energy formalism to characterize parameter regimes and critical thresholds for robust attention inference. The resulting free-energy landscape incorporates randomness in query states and attention weights. Attent...
Jerry Yao-Chieh Hu, Yu-An Chen, Maojiang Su et al.· 0 citations
AI-generated outputs are frequently perceived as highly creative, but also tend to be more similar to each other (homogenized) than human ideas. Does the human heterogeneity that extends beyond AI reflect valuable thinking that AI misses? Alternatively, is greater human heterogeneity driven by lower-quality ideas and l...
Kibum Moon, Dan R. Johnson, Kostadin Kushlev et al.· 0 citations
Deep learning has become the dominant form of machine learning due in part, to its ability to automatically engineer complex meta features from data. However, even deep learning features can perform erratically because of unobserved latent factors. incorporating latent factor information explicitly, can improve perform...