What is entropy-based uncertainty in model evaluation?

Entropy-based uncertainty measures randomness in model predictions.

Entropy quantifies uncertainty in probability distributions. In classification, high entropy means the model is uncertain across classes. It is widely used in active learning, OOD detection, and ensemble methods. Entropy can be decomposed into aleatoric (data noise) and epistemic (model uncertainty).