# Attention Is All You Need **Entity class:** Publication **Research spine:** [[research/Chronology of Signals, Silos, and Sovereign Software - Research|Chronology of Signals, Silos, and Sovereign Software]] ## Definition Attention Is All You Need is the 2017 Google research paper that introduced the Transformer architecture based primarily on attention mechanisms. ## Chronological Proximity It appeared between Shannon's 1948 experiment and the 2019 release of [[wiki/GPT-2|GPT-2]], providing the architecture that scaled conditional language modeling. ## Relational Proximity Its authors introduced the [[wiki/Transformer Architecture|transformer]], whose masked attention underlies GPT-2's long-context [[wiki/Next-Token Prediction|next-token prediction]]. ## Collection Routes [[collections/The Civilian Intelligence Marketplace|The Civilian Intelligence Marketplace]] · [[collections/Terrorism, Counterterrorism, and the Intelligence Environment|Terrorism, Counterterrorism, and the Intelligence Environment]] · [[wiki/Signals, Silos, and Sovereign Software|Signals, Silos, and Sovereign Software]] ## Sources / Provenance - [[research/Chronology of Signals, Silos, and Sovereign Software - Research|Chronology of Signals, Silos, and Sovereign Software - Research]].