Self-Distilled Reasoner
Notes on On-Policy Self-Distillation, where one language model acts as both student and teacher by conditioning the teacher policy on privileged reasoning traces while supervising the student's own rollouts.
Notes on On-Policy Self-Distillation, where one language model acts as both student and teacher by conditioning the teacher policy on privileged reasoning traces while supervising the student's own rollouts.