Ran Flint on RTX PRO 6000 at NVFP4 in vLLM
Manged to get Flint running in vLLM (with the flint PR) on my RTX 6000 Pro. The model was using my harness well, using OKF knowledge base, doing webscraping, spoke in the character I gave it, etc.
Manged to get Flint running in vLLM (with the flint PR) on my RTX 6000 Pro. The model was using my harness well, using OKF knowledge base, doing webscraping, spoke in the character I gave it, etc.