MonitrLLM: A Community-Centered Evaluation Infrastructure for Large Language Models
MonitrLLM is introduced, open-source infrastructure for community-centered LLM evaluations that links full conversation transcripts to user-reported task intent and outcome assessments, treating all three as primary evaluative signals rather than optional metadata.