New SRD sharing post: A new on-policy self-distillation method called Shared Residual Distillation enables language models to learn from their own unverified peer trajectories without needing external…

#SelfDistillation #LanguageModels #MachineLearning #AIResearch
https://arxiv.org/abs/2610.22080