Large language models (LLMs), when acting as agents, are expected to take observed data in context, infer the latent state space underlying the world, and leverage it for downstream prediction. However, prior work demonstrated that LLMs struggle to use representations learned in context on a graph tracking task, where...
Kohsei Matsutani, Gouki Minegishi, C. Park et al.· 0 citations
The neurofeedback paradigm for LLMs is redesigned so that the control target satisfies the privileged access requirement, which is closer to neurofeedback experiments in human cognitive neuroscience and indicates that rigorous assessments of metacognition in LLMs require evaluation methods that demand privileged access...
Koshiro Aoki, Ryota Takatsuki, Gouki Minegishi et al.· 0 citations
A symbolic-attribute oracle shows that CoT can improve counting once ground-truth attributes are supplied as text, while a single-object probe-vs-decode check shows that hard attributes can be linearly recoverable from hidden states yet difficult for the model itself to output.
A taxonomy of CoT is proposed consisting of Explicit CoT, which outputs all operations without aggregation, Composed CoT, which combines multiple operations into a single step, and Implicit CoT, which omits intermediate operations.
Kohsei Matsutani, Gouki Minegishi, Takeshi Kojima et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.