Why Deep Learning Researchers Love EMA

From Moving Average to DINO’s Stable Representation Learning