A personalized Korean visual speech recognition (VSR) system is presented and the gap between the population-level benchmark score and an individual user's error is quantified, on the nine-camera OLKAVS corpus.
Se Un Park, Hak-seon Kim, Tae-Hoon Roh et al.· 0 citations
Results show that BLV-focused post-training improves both accessibility-specific spatial grounding and general visual-text reasoning, and is substantially outperforms the baseline across various benchmarks.
Rishabh C. Choudhary, S. Raj, Umesh Goyal et al.· 0 citations
SemMSA, a latent semantic-aided framework that constructs rich sentiment-relevant semantics with LLMs, fully integrating with all modalities via anchor-free spectral alignment, is proposed.
Wen-Hao Li, Zhi-Bin Wu, Chong-Yao Xiao et al.· 0 citations
This hybrid system uses large language models to propose and ground visual elements, estimate their salience to the narrative, and generate compressed realizations, which makes better decisions than prompted LLMs about what to describe and when to describe it.
Igor Sterner, Mirella Lapata, A. Lascarides et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Managing municipal solid waste in rapidly urbanizing Sub-Saharan Africa remains challenging due to dispersed informal dumping and limited high-resolution datasets for spatial monitoring. We present an open-access deep learning model for automated detection of openly dumped dispersed solid waste via crowdsourced UAV ima...
Steffen Knoblauch, Ram Kumar Muthusamy, Luis M. A. Bettencourt et al.· 0 citations
CatSIM uses a structural similarity image quality paradigm and is robust to small perturbations in location so that structures in similar, but not entirely overlapping, regions of two images are rated higher than using simple matching.
Geoffrey Z. Thompson, Ranjan Maitra· arXiv.org· 2 citations
Graph-Optimized Multimodal Alignment (GOMA), which lets a jointly trained model support single-modality and dual-attribute retrieval through a task-specific readout, achieves state-of-the-art performance on all 14 primary measures against 14 external methods.
An analytic imbalance rectifier (AIR) algorithm for real-world CL is proposed that addresses class imbalance with an analytic reweighting module (ARM) that calculates a reweighting factor for each class in the loss function to equalize total sample weights across classes.
Di Fang, Yinan Zhu, Run-Ze Fang et al.· arXiv.org· 12 citations· ⚡1
Internal visual-text alignment in MLLMs is best read as a geometric diagnostic of the visual stream inside the language model rather than a direct proxy for content-level cross-modal interaction, and is most informative when calibrated by controlled task evidence.
It is argued that confusion can be attributed to distinct, separable sources, each quantitatively measurable, turning a passive measurement into actionable guidance, and presents A^2E^2, a diagnostic tool that decomposes the sources of confusion along two axes.
The value of reusable coefficient fields for accurate reconstruction beyond the supervised resolution with low incremental arithmetic cost is demonstrated and SCOPE leads the compared methods across six metrics in the main supervised-scale evaluation.
Ze-Kai Shi, Meng Zhang, Hao-Kun Zhang et al.· 0 citations
Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.