Writing

Notes on systems, protocols, and models. Full posts, rendered here from the original markdown.

Towards the Modern Transformer Architecture

Tracing how the 2017 Transformer evolved into the recipes used by modern frontier models — norms, activations, attention variants, RoPE, KV cache, and more.

Jul 22, 2026 · 36 min

Hashnode