Skip to content
Review

Overview of FinMMEval 2026 Task 3: Live Financial Decision-Making Agents

2026 · Conference and Labs of the Evaluation Forum · pp. 2542-2552 · 3 citations · 27 references
Computer Science

TL;DR

Within the official scoring window, simulated returns differed sharply by asset: Infraglyph led the cross-asset mean CR, Fin-Analyst achieved the highest TSLA return, and NLP-DE achieved the highest BTC return.

View source

Similar papers

Sep 2026

LiveOption: Evaluating LLM Agents in Structured Option Trading with Nonlinear Payoffs

This work introduces LiveOption, an evaluation framework for LLM-based agents in option trading that formulates the problem as structured sequential decision-making under realistic execution and capital constraints, and provides a reproducible environment with standardized interaction protocols.

Hao-Chen Luo, Yi-Fan Li, An Binh Minh et al. · 0 citations
Preprint Oct 2026

BizAgentBench: Unveiling Hidden Challenges in Deploying Long-Horizon Agents for Real-World Business

Existing long-horizon agent benchmarks often emphasize final task success while providing limited assessment of intermediate execution validity. Yet real-world business operations require agents to navigate extensive, potentially outdated or conflicting policies while satisfying critical constraints throughout executio...

E. Zhao, Yong-Qi Tong, Xue-Jun Yu et al. · 0 citations
Preprint Nov 2026

BuySideFlow: A Point-in-Time Benchmark for LLM Agents in Investment Research

Large language models (LLMs) can generate SQL and SQL--Python workflows for investment research, but ensuring point-in-time (PIT) validity remains challenging. Agents must enforce disclosure cutoffs and select the appropriate historical states and record versions throughout data retrieval and financial analysis. We int...

Dong Bo, Fan-Jin Zhang, Ke Cheng et al. · 0 citations
2026

The Lab Rats @ FinMMEval 2026 Task 3: Online Threshold Calibration and Cross-Asset Regime Gating for Live Financial Decision Making

FinSentinel v2, the authors' deterministic, rule-based trading agent submitted to CLEF 2026 FinMMEval Task 3 (Financial Decision Making), builds on a signal-fusion architecture with asset-specific decision policies with three targeted mechanisms.

Awais Gill, Emaan Naveed Sheikh, Fatima Tu Zahra et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.