I tried reversing chat templates to see which models are the best at generating user turns
I tried for fun to see what happens if we let instruction-tuned LLMs generate the text that should come from the user (so after the user_start special token). I immediately noticed that some models were way better than others.