Synapse Open Synapse
AI

The Transformer Family Version 2.0

Lil'Log · · 49 min read

Many new Transformer architecture improvements have been proposed since my last post on “The Transformer Family” about three years ago. Here I did a big refactoring and enrichment of that 2020 post — restructure the hierarchy of sections and improve many sections with more recent papers.

Latest from Lil'Log