juniorQ-Learning
What is the Q-table in Q-Learning?
Updated May 17, 2026
Short answer
A Q-table stores Q-values for all state-action pairs.
Deep explanation
It is a lookup table where rows represent states and columns represent actions. Each cell stores expected future rewards, updated iteratively during training.
Real-world example
Used in small grid-world navigation problems.
Common mistakes
- Assuming Q-tables scale well to large or continuous state spaces.
Follow-up questions
- Why does Q-table not scale well?