What is Inverse Propensity Scoring (IPS)?

IPS corrects bias in offline evaluation using action probabilities.

IPS reweights observed rewards by inverse probability of the action taken under the logging policy. This corrects selection bias in observational datasets, enabling unbiased estimation of new policies. However, IPS can have high variance when propensities are small.