How Does It Work? (Part 1): From Text to Numbers
How Does an LLM Work?
How a sentence becomes tokens, tokens become vectors, and vectors travel through 96 transformer layers. Part 1 of the mechanistic explanation.
1
Learning Material
5 pagesLesson 4 — How Does It Work? (Part 1): From Text to Numbers
Understanding the Complex: How Does an LLM Work?
The anchor example:
"The capital of France is ___"
You know the answer. The model gets there through four mechanical steps. This lesson covers the first two.