27B vs Flash next
Hey guys, I need some advice. My actual setup is this: ryzen 5600 / 32GB RAM / 128GB SSD / 32GB VRAM (2x16GB 5060ti) Running vLLM with Qwen 27B NVFP4 with 250k context.
Hey guys, I need some advice. My actual setup is this: ryzen 5600 / 32GB RAM / 128GB SSD / 32GB VRAM (2x16GB 5060ti) Running vLLM with Qwen 27B NVFP4 with 250k context.