Synapse Open Synapse
AI

Large Transformer Model Inference Optimization

Lil'Log · · 29 min read

[Updated on 2023-01-24: add a small section on Distillation .] Large transformer models are mainstream nowadays, creating SoTA results for a variety of tasks. They are powerful but very expensive to train and use.

Latest from Lil'Log