Show HN: New Model- NCM Model – Are Memory Hungry LLMs Dead
The biggest bottleneck of running top open models locally is memory bandwidth and sadly the ram costs are off the roof, if there's still a roof, sam altman wants your pc ram for his data centre btw.