2026· International Conference on Conceptual Structures· pp. 294-308· 0 citations· 39 references
Computer Science
TL;DR
These findings suggest that direct configuration prediction provides a robust approach despite ambiguity in the parameter space, and are compared to a regression-based performance prediction model, a multiple-choice model that treats near-optimal configurations as valid targets, and a baseline single-label model.
PEFT-Assess is presented, a systematic framework for evaluating the adaptability of four mainstream PEFT methods—LoRA, QLoRA, Adapter, and Prefix-Tuning—across five evaluation dimensions: accuracy, F1-score, training speed, memory efficiency, and generalization capability.
Zhaoyang Hu, Shi-Xuan Cao, Yuqi Sun et al.· International Conference on...· 0 citations
Evolutionary Soups, a mixture-of-experts framework for fine-grained generation control, with gating networks trained via an evolutionary algorithm, achieves the best hypervolume, linear utility, and Tchebyshev utility among controllable methods on all tasks.
Lingxiao Kong, Steffen Staab, Cong Yang et al.· 0 citations
DearICL (Data Efficient Algorithm for Ranking) ICL samples, a new framework that models demonstration example selection as a subset ranking problem, achieves 8.08-15.9% accuracy gains over strong linear bandit baselines, with low sample complexity.
Experiments show that DIAG boosts yield across iterations and delivers stronger reasoning performance under an iso-effective training budget, demonstrating that it can distill more informative preference supervision for mathematical reasoning.
Gu-Han Chen, Songtao Tian, Bo-Han Li et al.· 0 citations
Model Internal State Optimization (MISO), a systems workflow that uses model internal states (MIS), including parameters, activations, gradients, and normalization statistics, to prioritize such local optimization decisions.
Yongzhen Zhang, Xiaoyu Deng, Yifan He et al.· 0 citations
Although parameter-efficient fine-tuning significantly reduces the computing cost of deep models, default configurations are insufficient to perform as good as full fine-tuning for challenging large-cardinality intent detection problems with 77-151 intents. Thus, this work presents the S1 configuration that is proposed...
Harsh Anand, Sofia Singh, Rahul Agrawal et al.· 2026 International Conferenc...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
