EvalMem: An Operation-Level Diagnostic Framework for Long-Term Memory Systems
Long-horizon interactions with LLM-based assistants require memory systems that preserve and update user states, preferences, and interaction histories. Existing evaluations report end-to-end QA accuracy and cannot determine whether errors arise from encoding, retrieval, or generation. We introduce EvalMem, an operatio...
Ze-Yu Liu, Jian-Yuan Zhong, Rong-Duo Han et al.
· 0 citations