My 0.8B fine-tune proofreads Spanish at 138 ms per sentence on a CPU
I have been building a Spanish proofreader that runs fully local, and it's finally released, so I wanted to share how it went. It only corrects Spanish, but I think the approach works for other languages and narrow tasks too.