Skip to content
Open access

Trustworthy Contracts AI: Explainable Multi-Label NLP with Legal-BERT, T5, and SHAP

Oct 2026 · International Journal of Intelligent Systems and Data Science · Vol 1 · 0 citations · 24 references

TL;DR

An end-to-end explainable AI framework for contract analytics that combines multi-label clause detection with Legal-BERT, abstractive summarization via T5, and layered interpretability using SHAP, LIME, and attention visualization to generate lawyer-readable rationales is presented.

Abstract

Legal contract analysis remains a time-intensive manual process despite advances in natural language processing. This paper presents an end-to-end explainable AI framework for contract analytics that combines multi-label clause detection with Legal-BERT, abstractive summarization via T5, and layered interpretability using SHAP, LIME, and attention visualization to generate lawyer-readable rationales. Trained and evaluated on the Contract Understanding Atticus Dataset (CUAD) comprising 510 contracts across 41 clause types, the system addresses long-document constraints and severe class imbalance through sliding-window inference and weighted losses. Experimental results demonstrate strong multi-label performance with F1-micro of 0.8924 and low Hamming loss of 0.0023, alongside competitive ROUGE scores for summarization (ROUGE-1: 0.6054). Beyond offline metrics, a containerized web application demonstrates practical deployment viability. The framework's transparent attributions over legally salient spans significantly improve practitioner trust and decision support in high-stakes legal NLP applications, advancing responsible AI adoption in legal technology.

Read PDF

Similar papers

Breaking Bureaucracy: Evaluating open-source LLMs for legal document review

In this paper, we evaluate open-source generative LLMs on legal Natural Language Inference (NLI). Legal inspectorial processes take place in specific domains and often deal with confidential data. This creates a need for working with local models that do not require labeled training data. We evaluate our models on the...

Farrukh Baratov, Niki van Stein, Suzan Verberne · 0 citations
#natural language process... Preprint Nov 2026

Evaluation Contracts and Evaluation Leverage: Sliced-Gap Readings in Structured Prediction Can Move Without Model Change

NLP evaluation reports routinely cite sliced performance differences, most prominently the intra-inter gap in document-level relation extraction, as capability evidence. We show that such gap readings are joint properties of models and evaluation contracts: scoring function, gold version, threshold, output format, and...

Hao Lu, Wei-Xing Zhu, Rui-Yang Li · 0 citations
#natural language process... Preprint Sep 2026

LAURA: Knowledge Distillation for Interpretable Ambiguous Clause Identification in Legal Contracts

Legal contracts contain ambiguities that expose enterprises to financial and legal risks. Some ambiguities allow flexible interpretation without triggering disputes, while others lead to significant legal conflicts. This makes identification alone insufficient, and interpretable rationale analysis essential. We propose...

Amrita Singh, Aditya Joshi, Jiao-Jiao Jiang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

UDHRBench: Benchmarking Human Rights in Large Language Models

Large language models are increasingly deployed in contexts requiring adherence to ethical and legal norms, yet their alignment with internationally recognized human rights standards remains underexplored. We introduce UDHRBench, a large-scale benchmark for operationalising the evaluation of large language model compli...

Alak Raad, Noreldin Morssy, Zeerak Suhail et al. · 0 citations
Open access 2026

Bridging Claims and News for Cross-Dataset Fake News Detection: Hierarchical Veracity Learning and Evidence-Guided Expert Routing

Cross-dataset fake news detection remains challenging because claim-level fact verification and news-level misinformation recognition differ substantially in input granularity, contextual richness, and label structure. This study proposes C2N-HIVE, a unified framework that combines hierarchical veracity learning, split...

Shi-Qiang Li, Yuan-Hao Chen, Hyoungil Joo · 0 citations
#artificial intelligence Open access Sep 2026

Human Agreement and Return Association Are Not Interchangeable Criteria

Financial NLP has a standard workflow: validate a sentiment tool against human labels, then trust it to extract market signal, but it is found that the relationship between construct and predictive validity depends on the sampling convention and score representation.

A. Aravinthakshan, Laven Srivastava, Harsh Nandwani · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.