This work introduces a Hierarchical Dirichlet Process Gaussian Mixture Model over behavior embeddings, which shares components across domains while allowing domain-specific mixing weights, and uses the posterior predictive to retrieve relevant behaviors for a query, and shows that the Bayesian Cheatsheet is an adaptive...
Keshav Ramji, Tahira Naseem, R. Astudillo· 0 citations
Hypernetworks have recently shown success in dynamically adapting the parameters of Large Language Models (LLMs) at runtime based on signals such as task descriptions or additional demostrations. Here we ask: how much adaptation signal can be obtained using only the input query to an LLM?. To answer this, we study quer...
A. Khan, Keshav Ramji, Tahira Naseem et al.· 0 citations
BOReFT is introduced, which learns a compact, low-dimensional space of hidden-state interventions in a frozen language model, and uses this space as the search domain for Bayesian optimization with an external scoring function, and provides a principled new bridge between discrete proposal spaces of LLM-based search an...