Importance Sampling in Reinforcement Learning

Importance Sampling (IS) is a statistical technique used to estimate expectation under one distribution using samples from another.