What is Elo rating system in model evaluation?

Elo system assigns dynamic ratings based on pairwise competition outcomes.

Elo rating updates model scores based on expected vs actual outcomes in pairwise comparisons. It is widely used in ranking LLMs, recommender systems, and tournament-based evaluation setups. It dynamically adjusts ratings, making it suitable for continuous evaluation pipelines.