Skip to content

Beyond Intelligence: Defining and Measuring Wisdom for AI

Nov 2026 · Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI

Abstract

Abstract Personal advice from AI fails in documented ways. It tells people what they want to hear, it loses track of what matters in long conversations, and it changes when only the person’s identity changes. These failures are mostly measured one at a time, and mostly in English. Tests of knowledge and emotional intelligence do not show whether advice is wise. This conceptual paper defines wisdom as seeing what a situation truly calls for and acting on it for the good of those affected, not for one’s own approval or comfort. To make that testable, we propose the HEED model, built from Shivanand’s reading of the Sanātana (Sanatan) texts; research in AI and psychology has reached many of its parts by other routes. The model has six parts. Knowledge is what a system knows. Values are what it holds worth protecting. Context is what is true of this person and this situation. Discernment is seeing which of these apply here and now. Endurance is keeping Values and Context in use as a conversation grows. Ego is the pull to please, to defend one’s own answer or to push against the person. The model proposes that Discernment multiplies the other parts and Ego divides them; that structure is a hypothesis to be tested. One rule is not a hypothesis but a value commitment: an answer that would cause or enable avoidable serious harm scores zero for wisdom on that situation, whatever its other strengths. A system’s result is a wisdom profile across many situations, not a single number. To test the model, we propose a research design. The same personal dilemmas would be put to AI systems in English, Hindi and natively written Hinglish (the mix of Hindi and English that many Indians write), in versions that change one thing at a time: a fact, an identity label, a push from the user, or the length of the conversation. Two separate panels of native-speaking experts would score the parts and rate overall wisdom. Five hypotheses, registered before data are collected, would test whether the model’s way of combining the parts fits the experts’ ratings better than simply adding them; whether the approval and ownership effects go together; whether, as conversations grow, systems use less of what they can still recall; whether the approval effect differs between Hindi or Hinglish and English; and whether advice moves with relevant facts rather than with identity labels alone. Measuring the parts together could show when fixing one failure creates another, such as resisting pressure but ignoring good reasons. The paper reports no results. The research would revise the model in light of its findings before an open benchmark, HEEDBench, is built from it. Keywords: wisdom; artificial wisdom; wise reasoning; AI advice; sycophancy; large language models; AI benchmarks; HEED model; HEEDBench; Sanatan; Shiva Sutras; Hindi and Hinglish

View source

Similar papers

#artificial intelligence Conference Open access Jun 2018

Gibson Env: Real-World Perception for Embodied Agents

This paper investigates developing real-world perception for active agents, proposes Gibson Environment for this purpose, and showcases a set of perceptual tasks learned therein.

F. Xia, Amir Zamir, Zhi-Yang He et al. · 1,069 citations · ⚡112
#artificial intelligence Open access May 2023

Evaluating the Performance of Large Language Models on GAOKAO Benchmark

GAOKAO-Bench is introduced, an intuitive benchmark that employs questions from the Chinese GAOKAO examination as test samples, including both subjective and objective questions that contribute a robust evaluation benchmark for future large language models and offers valuable insights into the advantages and limitations...

Xiaotian Zhang, Chun-yan Li, Yi Zong et al. · 216 citations · ⚡17

KTO: Model Alignment as Prospect Theoretic Optimization

This work proposes a HALO that directly maximizes the utility of generations instead of maximizing the log-likelihood of preferences, and suggests that the best loss depends on the inductive biases most appropriate for a given setting, an oft-overlooked consideration.

Kawin Ethayarajh, Winnie Xu, Niklas Muennighoff et al. · 195 citations · ⚡28
#artificial intelligence Open access Jul 2024

Gender, Race, and Intersectional Bias in Resume Screening via Language Model Retrieval

This work investigates the possibilities of using LLMs in a resume screening setting via a document retrieval framework that simulates job candidate selection and finds that the MTEs are biased, significantly favoring White-associated names in 85% of cases and female-associated names in only 11.1% of cases.

Kyra Wilson, Aylin Caliskan · 131 citations · ⚡8
#artificial intelligence Review Nov 2024

How to Build a Quantum Supercomputer: Scaling from Hundreds to Millions of Qubits

This work shows that orders of magnitude enhancement in performance could be obtained by a combination of hardware improvements and tight quantum-HPC integration and introduces high-performance architectures for quantum-probabilistic computing with custom-designed accelerators to tackle today's industry-scale classical...

Masoud Mohseni, Artur Scherer, K. Johnson et al. · 121 citations · ⚡9

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.