Library

I don't collect papers. I collect ideas that change how I build systems.

Why it's in my library

Everything else in this library assumes this paper. Self-attention is the reason retrieval, agents, and long-context evaluation are even the right things to be arguing about โ€” it's the substrate, not a technique applied on top of one.

Key ideas

TransformersSelf-AttentionArchitecture

Read paper โ†—arxiv.org