1. Cover
  2. Introduction
  3. Main Content
  4. 1. Chapter 1: Solving Cryptograms by Designing a Transformer
    1. 1.1. Letter Frequency Solution
    2. 1.2. Transformer Implementation
      1. 1.2.1. Embeddings
      2. 1.2.2. Attention
      3. 1.2.3. Unembeddings
    3. 1.3. Improving the Accuracy
    4. 1.4. Arbitrary Embeddings
  5. 2. Chapter 2: Revealing the "True" Structure from Trained Feedforward Nets
    1. 2.1. A Single-Layered Network
  6. Appendix A: Mathematical Preliminaries
  7. Appendix B: Distance and Similarity

LLM Foundations

Improving the Accuracy