Microsoft Research backdoored an AI agent by directly editing fewer than 10 dormant neurons
Be careful if you are running any sketchy quants/finetunes. If these techniques become more widely repeatable, I do think 'sleeper agents' could genuinely develop into an attack vector. What are your thoughts?