Teaching foundation models new skills without breaking them is hard. A new reinforcement learning-based approach might have the power to change that.
The post Could On-Policy Self-Distillation Revolutionize Post-Training? appeared first on Towards Data Science.