Models are chasing unrealistic benchmarks but the working-level intelligence is already achieved
I have a feeling that recent benchmarks are unrealistically pushing the bar into areas a normal developer rarely encounters, like binary reverse engineering or one-shotting a complex application, with some strictly chosen design patterns.