What is hallucination in large language models?

Hallucination occurs when models generate plausible but incorrect information.

LLMs generate text based on probability distributions, not factual verification. When lacking grounding or retrieval, they may produce incorrect yet fluent outputs. Techniques like RAG and constrained decoding help reduce hallucination.