Show HN: NeuroBrix – PyTorch-free local inference with a Rust grammar engine
NeuroBrix 0.6.5 NeuroBrix 0.6.5 brings constrained decoding and a faster, longer-reaching serving daemon, with nbxtensor 0.1.0 and nbxgrammar 0.1.0. Constrained decoding on the OpenAI API. respons...