What is experience replay in Q-Learning?

Updated May 17, 2026

Short answer

Experience replay stores past experiences for randomized training.

Deep explanation

It breaks correlation between sequential samples and improves data efficiency by reusing past transitions.

Real-world example

Used in robotics to learn efficiently from limited interactions.

Common mistakes

  • Training only on latest transitions.

Follow-up questions

  • Why shuffle experiences?
  • What is replay buffer size?

More Q-Learning interview questions

View all →