What is model routing in multi-model serving systems?

Model routing dynamically selects which model to serve based on input or context.

Routing systems decide between multiple models using rules, classifiers, or bandit algorithms. This enables cost optimization, specialization, and fallback strategies. For example, small models handle easy queries while large models handle complex ones.