Any progress on continuous learning prompt, will we have meaningful weights plasticity or they'll stay forever frozen?
So I'm wondering if we til ever have repeated data ingestion without quality degradation and without full retraining. LoRA and friends are excluded, will we stay forever with frozen weights or will be be able to integrate new knowledge here? Any promising research?