[Paper] Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights
TL;DR We find that frontier LLMs are surprisingly good at natively reading and writing neural network weights , well past what we’d expect from humans or conventional algorithms. This might be a big deal for both optimization and interpretability.