FrontierMat, a benchmark of 330 problems drawn from frontier academic and industrial research in fields including aerospace, semiconductors, embodied intelligence and nuclear fusion, is introduced, providing a testbed for measuring progress toward language models that support frontier materials R&D.
Feng Chen, Jian-Guo Huang, Yu-Shan Xiao et al.· 0 citations
Genetic programming (GP) has been widely used to learn scheduling rules for dynamic flexible job shop scheduling (DFJSS). However, trained rules tend to only generalise to tasks of similar scales and distributions, and when task characteristics change, learned rules often suffer significant performance degradation. Mor...
Luyao Zhu, Fangfang Zhang, Yi Mei et al.· 0 citations
Agentic systems increasingly gate individual steps with a pointwise judge that scores a response against a criterion. Small language models are attractive for this role because they can be served and specialized efficiently. Such a judge must locate the criterion's decision boundary, but pointwise labels under-determin...
Mohammad Zangooei, Peyvand Teymoori, Mohammad Robati Shirzad et al.· 0 citations
The Pairwise Coordination Policy (PCP), which uses exact one- and two-task problems to estimate how pairs of tasks delay each other when they share the human, is proposed.
A benchmark of 400 multiple-choice questions that combines widely known inside-knowledge inside-knowledge questions, which should be answered directly, with outside-knowledge questions about facts from news published after the models'training cut-offs is introduced, which should trigger search or, without tools, absten...
PACE (Proxy Alignment and Curvature Expansion), a pre-optimization diagnostic that uses repeated human ratings to predict the human-gain curve induced by a fixed proxy, characterizes gentle optimization along the positive tilt branch of a fixed item pool.
Quantization of Large Language Models (LLMs) has be- coming increasingly important for reducing the computa- tional costs and resource requirements for practical deploy- ment.Growinginterestinthisareahasmotivatedthecommu- nity to move beyond 8-bit quantization towards 4-bit preci- sion, leading to the development of cu...
Jing Huang, Yu Cheng, Ziwei Yu et al.· 0 citations
Manifold learning methods like t-SNE and UMAP preserve local neighborhoods, but they do not preserve the ranking of the neighbors inside them. Two embeddings can return the same neighbor set while disagreeing on which point is closest. This loss of order degrades downstream applications that value the order in the embe...
Time-series foundation models (TSFMs) provide zero-shot forecasts for unseen series, but their accuracy varies across datasets. Combining several models can reduce this variability, yet zero-shot deployment provides no target labels for selecting or weighting them. We find that a model pool is useful not only as a fina...
Junhyeok Kang, Sangjun Han, Jun Seo et al.· 0 citations
In text-to-SQL and AI-agent analytics, successful SQL execution does not establish semantic correctness under changing business definitions. We study revalidation of fixed queries after changes to refund attribution, tax treatment, eligible populations and exchange-rate dates. An executable verification profile binds t...
Gen-Liang Zhu, Xiao-Bo Chen, Zi-Yu Wang et al.· 0 citations
CIRCE is introduced, which extracts a problem's structure by using a cheap LLM to construct a Constraint Intermediate Representation that deterministically compiles into the constraint graph.
Chen-Hao Hong, Jia-Kai Xu, Kaushiki Singh et al.· 0 citations
These results separate multi-hop candidate discovery, record-based discrimination and review prioritization within an explicit synthetic evaluation design for payroll-fraud screening from record-aware rules.
Xiao-Bo Chen, Gen-Liang Zhu, Zi-Yuan Wang et al.· 0 citations