This appendix is a comprehensive reference to the vocabulary of large language models. It spans five sections organized by domain: libraries and frameworks (F.1), models and architectures (F.2), algorithms and techniques (F.3), NLP and AI concepts (F.4), and applications and deployment (F.5). Each entry includes a concise definition and a cross-reference to the section of the book where the concept is treated in depth.
LLM terminology can be imprecise and fast-moving. The same concept may appear under different names across papers, blog posts, and library documentation. This glossary establishes the definitions used consistently throughout this book and provides a stable anchor when terminology in the broader field is ambiguous or contested.
This appendix is useful for readers at every level: newcomers building vocabulary, practitioners checking precise definitions before using a term in a report or paper, and anyone working across multiple domains who needs a single reference rather than hunting through chapters.
Terms in this glossary connect to every part of the book. Architecture vocabulary connects to Chapter 4 (Transformer Architecture). Training and optimization terms connect to Chapter 14 and Chapter 15. Evaluation and deployment terms connect to Chapter 29 and Chapter 31.
Terms are organized alphabetically within each section. Each entry includes a concise definition and a cross-reference to the section where the concept is discussed in depth. Use your browser's search function (Ctrl+F or Cmd+F) to jump to a specific term quickly. No prerequisites are required; this appendix is a reference, not a tutorial.
Return here whenever a term appears in the main text that feels unclear or has multiple competing definitions you have seen elsewhere. This appendix is also useful when writing about LLMs and wanting to verify standard usage before committing to a definition in a report or paper. For deeper explanations of any term, follow the cross-references to the relevant chapters rather than relying solely on glossary definitions.