Various deep learning architectures including the domain-specific pre-trained transformers for the task of legal sentence classification are explored, finding that domain-specific transformer models lead the row.
This work presents vilaw-bench, a novel evaluation benchmark tailored for Vietnamese statute-based legal reasoning that assesses cognitive abilities from basic knowledge retrieval to complex legal interpretation, and proposes a multi-stage training framework that progressively builds legal expertise through four phases...
Thang Le, Anh-Cuong Le, Viet-Ha Nguyen et al.· ACM Transactions on Asian an...· 0 citations
In this paper, we evaluate open-source generative LLMs on legal Natural Language Inference (NLI). Legal inspectorial processes take place in specific domains and often deal with confidential data. This creates a need for working with local models that do not require labeled training data. We evaluate our models on the...
Farrukh Baratov, Niki van Stein, Suzan Verberne· Proceedings of the 15th Inte...· 0 citations
Text content is the dominant factor in annotation decisions, far outweighing annotator demographics, and that content-focused SHAP explanations are more effective than demographic persona prompting for guiding LLM annotations, showing that explainability methods can improve both the reliability and the transparency of...
A sentence-level benchmark for evaluating the ability of LLMs to classify interpretive canons as articulated by Larenz in the tradition of Savigny is contributed, operationalizing this conception of interpretation as classification criteria.
Felix Ringe· arXiv.org· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduNov 20, 2026
An MIT and Dana-Farber Institute-led team used large language models to examine nearly 4,000 studies and hundreds of code repositories, revealing gaps in the information needed to scrutinize and reuse published research.