LongAct: Training Models to Stay Stable When Context Gets Long

There is a point where language models stop failing apparently but failing due to long context.