Research
Paper breakdowns
A breakdown is our technical reading of one influential paper: what problem it tackled, how the method works, what the authors report and where the evidence stops.
Numbers are the authors’ own reported results, quoted from the paper and checked against the source. We don’t re-run the experiments, and we say so.
Every breakdown covers
- TL;DR
- The problem
- The method
- What the paper reports
- Why it mattered
- Limitations
- Reading notes
Tagged “Retrieval (RAG)”
1 breakdown of 6
Retrieval-Augmented Generation: pairing a language model with a searchable memory
A technical reading of the 2020 paper that introduced RAG models — how a dense retriever and a sequence-to-sequence generator are trained together, the difference between RAG-Sequence and RAG-Token, and what the results do and do not show.
- Retrieval (RAG)
- Large language models
- Architectures
- Paper authors
- Lewis et al.
- Paper year
- 2020
- arXiv identifier
- arXiv 2005.11401
New breakdowns by email
Sign up for email updates on new paper breakdowns. No issue has been sent yet.