Synapse Open Synapse
AI

Did we hit a wall in context length?

Reddit · r/LocalLLaMA · · 1 min read

I feel like midel context size rapidly went from 8k to 1M in just a few years but has since stayed this way for a while now. Some still offerring 260k or 400k for their flagship models. Is it just not worth the trouble?

Latest from Reddit · r/LocalLLaMA