Library

I don't collect papers. I collect ideas that change how I build systems.

Entries

Why it's in my library

Everything else in this library assumes this paper. Self-attention is the reason retrieval, agents, and long-context evaluation are even the right things to be arguing about — it's the substrate, not a technique applied on top of one.

Key ideas

TransformersSelf-AttentionArchitecture

Read paper ↗arxiv.org