How does temperature scaling affect cost functions in probabilistic models?

Temperature scaling adjusts confidence levels in probability distributions.

Temperature scaling modifies logits before softmax, controlling entropy of predictions. Lower temperature sharpens distributions, increasing confidence and reducing entropy. Higher temperature smooths outputs. This directly impacts cross-entropy cost by reshaping probability gradients.