UniSD: Towards a Unified Self-Distillation Framework for Large Language Models
A unified framework that systematically studies self-distillation for large language models, integrating complementary mechanisms for supervision reliability, representation alignment, and training stability.
May 7, 2026