Skip to content

CUET_Luminaries at SemEval-2026 Task 11: Disentangling Logical Validity from Semantic Plausibility through Canonical Abstraction

· 1 citation · 10 references

TL;DR

This proposed approach combines cross-validation, structured aggregation and bias-aware evaluation to optimize the robustness–performance trade-off, and achieves 93.19% accuracy with a TCE of 3.13, yielding a strong combined score of 38.56 under the official evaluation metric.

View source

Similar papers

#artificial intelligence Preprint Aug 2026

Validity-Aware Jailbreak Evaluation for Large Language Models

This work proposes Sequential Epistemic and Action-Level Validation (SEAV), a verification-centric jailbreak evaluation framework that decomposes responses into ordered steps and evaluates both validity and correctness, and shows that enforcing correctness substantially reshapes measured robustness.

Qilong Wu, Sahil Wadhwa, Pranab Mohanty et al. · 0 citations

Would You Walk to the Car Wash? Revealing the Salience Bias of Large Language Models in Commonsense Reasoning

The findings relocate the bottleneck of commonsense reasoning failures from model competence to elicitation, and release SaliTrap as a testbed for this blind spot, to show that lightweight, inference-time prompting alone substantially closes the gap without any retraining.

Zheng Wu, Chen-Hao Xue, Shijie Zheng et al. · 0 citations
Open access Jul 2026

Multi-Criteria Evaluation of Hierarchical Reasoning, Self-Correction, and Factual Consistency in Large Language Models across Complex Language Tasks

This paper introduces a comprehensive multi-criteria evaluation methodology designed to assess the capabilities of these advanced computational architectures in handling complex language tasks, focusing on three foundational dimensions: hierarchical reasoning, self-correction mechanisms, and factual consistency.

S. Yam · 0 citations
#machine learning Preprint Sep 2026

Legibility is Not Interpretability: Comparing Judged and Actual Importance in Chain-Of-Thought Reasoning

This work operationalizes the importance of a reasoning step as its advantage: the change in expected reward, e.g., producing the correct final answer, from including that step, estimated via Monte Carlo rollouts, and evaluates whether LLM judges can identify high-advantage steps and finds that sufficiently capable LLM...

Kevin Du, A. Hoyle, L. Ruis et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.