Synapse Open Synapse
AI

Any progress on continuous learning prompt, will we have meaningful weights plasticity or they'll stay forever frozen?

Reddit · r/LocalLLaMA · · 1 min read

So I'm wondering if we til ever have repeated data ingestion without quality degradation and without full retraining. LoRA and friends are excluded, will we stay forever with frozen weights or will be be able to integrate new knowledge here? Any promising research?

Latest from Reddit · r/LocalLLaMA