Self-keyed in-parameter memorization (SKIM), a closed-form method in which the model generates its own questions about each dialogue turn and writes those questions into its parameters as the keys that later retrieve the turn's content, is proposed.
Xin-Yu Piao, M. Ryu, Joongheon Kim et al.· 0 citations
A long-context recall method that maintains near-constant GPU memory usage as context length increases, without additional training is proposed, which enables answering single-fact questions in two-million-token story contexts where previous methods fail.
P2Skill is proposed, a prompt-based skill distillation method in which a local small language model (SLM) autonomously performs decomposition, PII-aware routing, paraphrasing, and reconstruction by following the skill prompts.
M. Ryu, Geunpyo Park, Sungjoon Lee et al.· 1 citation· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.