What is A/B testing in model evaluation?

Updated May 17, 2026

Short answer

A/B testing compares two models in production.

Deep explanation

Traffic is split between models to evaluate real-world performance differences.

Real-world example

Testing recommendation algorithms on users.

Common mistakes

  • Ignoring statistical significance.

Follow-up questions

  • What metrics used?
  • Why random assignment?

More Model Evaluation interview questions

View all →