Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!
This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.