A Deepdive into Aya Vision: Advancing the Frontier of Multilingual Multimodality
More from the blog
MIT Quantum Initiative launches postdoctoral fellowship program
The Institute welcomes its first cohort of QMIT Fellows this fall to advance interdisciplinary quantum research.
Measuring benchmark optimization in speech recognition
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Multi-Vector (Late Interaction) Embedding Models with Sentence Transformers
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Q&A: Rethinking how innovation happens
In his latest book, Professor Eugene Fitzgerald examines the forces that turn breakthroughs into value — and why innovation resists simple formulas.
Related papers
Spikformer V2: Join the High Accuracy Club on ImageNet with an SNN Ticket
This work introduces a pioneering exploration of Self-Supervised Learning (SSL) within the SNN, and proposes a novel Spiking Self-Attention (SSA) and Spiking Transformer (Spikformer) that achieves 80+% accuracy on ImageNet.
Iterative Flow Matching - Path Correction and Gradual Refinement for Enhanced Generative Modeling
This work explores image generation using flow matching using flow matching and proposes an iterative process that can be integrated into virtually any generative modeling technique, thereby enhancing the performance and robustness of image synthesis systems.
EgoMemReason: A Memory-Driven Reasoning Benchmark for Long-Horizon Egocentric Video Understanding
EgoMemReason is introduced, a comprehensive benchmark for week-long egocentric video understanding through memory-driven reasoning that evaluates three complementary memory types: entity memory, tracking how object states evolve and change across days; event memory, recalling and ordering activities separated by hours or days; and behavior memory, abstracting recurring patterns from sparse, repeated observations over the whole week period.
Mask2Real-WM: Segmentation Masks as a Sim-to-Real Bridge for Controllable Dexterous World Models
Mask2Real-WM is presented, a two-stage action-conditioned world model for dexterous manipulation that decouples pixel prediction into a dynamics model and a rendering model that shows that mask conditioning and simulation pretraining are both required for per-DoF action controllability across all 23 degrees of freedom.