Ahead of AI
- Understanding Positional Embeddings in Modern LLMsAhead of AI ·
The Methods Behind How LLMs Represent Token Positions
- Building Reasoning Models from the Ground Up: A Full Video CourseAhead of AI ·
Over 11 hours of coding videos on evaluation, inference-time scaling, reinforcement learning, and distillation, with Python and PyTorch.
- Language Models for Text Classification: From Bag-of-Words to JevAhead of AI ·
A Visual Guide to RNNs, CNNs, Transformers, and Calibration, with Hands-On Experiments on Accuracy and Efficiency
- GPT-6 Astra, Looped Transformers, and Hidden ReasoningAhead of AI ·
A Look at Recurrent Depth, Hidden Chains of Thought, and Recent Research on Looping Transformer Blocks
- How Claude Watermarks AI-Generated TextAhead of AI ·
A 48-minute video walkthrough of token sampling, watermark detection, and removal
- Building an AI Text Detector From ScratchAhead of AI ·
An End-to-End Project With Dataset Construction, Model Training, Local Deployment, and RLVR
- Controlling Reasoning Effort in LLMsAhead of AI ·
How LLMs Learn Low-, Medium-, and High-Effort Reasoning Modes
- Using Local Coding AgentsAhead of AI ·
Using Open-Weight Models in Local Coding Harnesses as an Alternative to Claude Code and Codex Subscriptions
- LLM Research Papers: The 2026 List (January to May)Ahead of AI ·
A curated roundup of notable LLM research papers that came out this year
- Recent Developments in LLM Architectures: KV Sharing, mHC, and Compressed AttentionAhead of AI ·
From Gemma 4 to DeepSeek V4, How New Open-Weight LLMs Are Reducing Long-Context Costs
- My Workflow for Understanding LLM ArchitecturesAhead of AI ·
A learning-oriented workflow for understanding new open-weight model releases
- Components of A Coding AgentAhead of AI ·
How coding agents use tools, memory, and repo context to make LLMs work better in practice
- A Visual Guide to Attention Variants in Modern LLMsAhead of AI ·
From MHA and GQA to MLA, sparse attention, and hybrid architectures
- A Dream of Spring for Open-Weight LLMs: 10 Architectures from Jan-Feb 2026Ahead of AI ·
A Round Up And Comparison of 10 Open-Weight LLM Releases in Spring 2026
- Categories of Inference-Time Scaling for Improved LLM ReasoningAhead of AI ·
And an Overview of Recent Inference-Scaling Papers
- The State Of LLMs 2025: Progress, Problems, and PredictionsAhead of AI ·
A 2025 review of large language models, from DeepSeek R1 and RLVR to inference-time scaling, benchmarks, architectures, and predictions for 2026.
- LLM Research Papers: The 2025 List (July to December)Ahead of AI ·
In June, I shared a bonus article with my curated and bookmarked research paper lists to the paid subscribers who make this Substack possible.
- From DeepSeek V3 to V3.2: Architecture, Sparse Attention, and RL UpdatesAhead of AI ·
Understanding How DeepSeek's Flagship Open-Weight Models Evolved
- Beyond Standard LLMsAhead of AI ·
Linear Attention Hybrids, Text Diffusion, Code World Models, and Small Recursive Transformers
- Understanding the 4 Main Approaches to LLM Evaluation (From Scratch)Ahead of AI ·
Multiple-Choice Benchmarks, Verifiers, Leaderboards, and LLM Judges with Code Examples
- Understanding and Implementing Qwen3 From ScratchAhead of AI ·
A Detailed Look at One of the Leading Open-Source LLMs
- From GPT-2 to gpt-oss: Analyzing the Architectural AdvancesAhead of AI ·
And How They Stack Up Against Qwen3
- The Big LLM Architecture ComparisonAhead of AI ·
From DeepSeek-V3 to Kimi K2: A Look At Modern LLM Architecture Design