In-Context Multiple Instance Learning
It is shown that pretraining an in-context learner with a Perceiver-style architecture on synthetic data yields a model that can solve new tasks from a handful of labeled bags, outperforming supervised baselines that require task-specific training.