Rather Qwen4-27b at 1M ctx than a big MOE at 128k
Larger context just gets more work done rather than having to re-read files ETC id much rather use my extra resources on context window. Instead of more params.
Larger context just gets more work done rather than having to re-read files ETC id much rather use my extra resources on context window. Instead of more params.