How does Q-Learning relate to dynamic programming?

Q-Learning is a model-free approximation of dynamic programming methods like value iteration.

Dynamic programming methods require full knowledge of environment transition probabilities, while Q-learning learns optimal policies directly from sampled experience. Q-learning can be viewed as stochastic asynchronous value iteration applied to sampled transitions.