AI Hallucination

AI hallucination is the failure mode where a model produces plausible but false, unsupported, or misgrounded output. In Making the most of AI, without the hype, Christopher Mims says hallucination is not simply a bug but part of how modern AI works, even as engineers continue reducing the rate of mistakes.

The concept gives a general reliability frame for narrower pages such as Legal AI Hallucination. Hallucination matters because fluent output can hide weak evidence, weak reasoning, or missing context, making Human Judgment Under AI, Output Quality Gates, and domain expertise part of safe AI use.

Key Claims

• Hallucination is not limited to one domain; it appears wherever a system produces confident-looking output without adequate grounding.
• Better models and retrieval systems can reduce hallucination, but they do not remove the user’s need to verify important claims.
• The risk is highest when the user lacks enough expertise to notice errors or when the output affects legal, medical, financial, educational, or operational decisions.
• Treating hallucination as a system property encourages review practices rather than blind trust.

Connections

• Christopher Mims, [[HowToAI|How to AI]], and Expertise-Amplified AI Use - source frame for why expertise matters.
• Human Judgment Under AI, Output Quality Gates, and Domain Expert Alignment - safeguards against plausible wrong output.
• Legal AI Hallucination, LLM World Model Gap, Retrieval-Augmented Generation, and AI Search Evaluation - related reliability and grounding concepts.