Automated machine learning (AutoML) reduces the cost of developing high-performing models by automating pipeline design, model selection, and hyperparameter optimization. As data sets increasingly combine heterogeneous sources (e.g., text, images, audio, and structured/tabular records), AutoML is extending to multimodal settings, where performance depends on representation learning and cross-modal fusion as well as model search. This survey reviews automated multimodal machine learning (MMAutoML), distinguishing core systems that automate both representation and fusion decisions from near-core systems, partial multimodal AutoML tools, and adjacent multimodal ML infrastructure. We organize multimodal learning around early, late, and hybrid fusion paradigms and discuss trade-offs in robustness, interpretability, and deployment. We then curate and compare representative open-source and commercial MMAutoML frameworks, summarize supported modalities, and characterize the ecosystem via time-evolution and similarity-based groupings. Finally, we overview applications in healthcare, autonomous systems, finance, and e-commerce, and highlight open challenges in modality alignment, missing or degraded inputs, efficiency and scalability, reproducibility, and governance (privacy, bias, and monitoring). We conclude with practical guidance and research directions toward reliable, end-to-end MMAutoML.
Online recommendation platforms increasingly use Large Language Models (LLMs) to extract structured features from ad creatives. While deploying a single-call LLM annotation agent yields significant Click-Through Rate (CTR) improvements in our live production environment, per-creative prompting is prohibitively expensive to scale. The redundant system instructions sent in every request account for 94% of billed input tokens. To break this cost bottleneck, we introduce PromptPack, a scalable, high-throughput LLM annotation agent. PromptPack achieves this scale via in-context batching, combining a shared system prompt, a strict XML structural envelope, and an output correction layer to ensure deterministic, pipeline-ready feature extraction across multiple creatives simultaneously. We evaluate PromptPack via an offline retrieval benchmark using a downstream logistic-regression ranker. To deeply profile the agent's behavior, we measure AUC and introduce Volume-Weighted Absolute Lift (VWAL), a novel metric capturing the signal quality of the generated features. Compared to our live, unbatched production baseline, PromptPack at batch size 20 cuts our LLM costs by 89% and accelerates throughput by 2.5x while fully preserving AUC.
Sebastian Koralewski, Merwan Barlier, Yulia Stolin et al.· 0 citations