What is the convergence condition of Q-Learning?

Q-learning converges under sufficient exploration and decaying learning rate.

Convergence requires visiting all state-action pairs infinitely often and decreasing learning rate satisfying Robbins-Monro conditions.