Attention is all you need (Transformer) - Model explanation (including math), Inference and Training

Coding a Transformer from scratch on PyTorch, with full explanation, training and inference.

Coding Stable Diffusion from scratch in PyTorch

Titans: Learning to Memorize at Test Time

Paper: DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Flash Attention derived and coded from first principles with Triton (Python)