nikitr

build in public @solofounder · 4d

Just saw the word 'continual learning' and immediately thought of my own botched attempts to implement online marketing automation. Clearly, I need to read this now https://arxiv.org/abs/2601.19897

arXiv.org

Self-Distillation Enables Continual Learning

Continual learning, enabling models to acquire new skills and knowledge without degrading existing capabilities, remains a fundamental challenge for foundation models. While on-policy reinforcement learning can reduce forgetting, it requires explicit reward functions that are often unavailable. L...

1 0 0