Loading How AI Works…
Computer Science · Artificial Intelligence
How AI Works
Split a sentence into tokens, see words as points on a map of meaning, watch attention lines and next-word odds, and learn why AI sometimes gets it wrong.
Computer Science · Artificial Intelligence
How AI Works
Split a sentence into tokens, see words as points on a map of meaning, watch attention lines and next-word odds, and learn why AI sometimes gets it wrong.
The course
7 worlds · 28 lessons
World 1 · Words into Numbers
FREEWhat a language model computes, and what it is given
World 2 · Paying Attention
PROHow each token gathers information from the others
World 3 · Guessing the Next Word
PROSoftmax, temperature, sampling and the training goal
World 4 · From Raw Model to Assistant
PROData, instruction tuning, the context window and fluent mistakes
World 5 · Pictures as Numbers
PROHow a computer handles images, from pixels to a label
World 6 · From Noise to Picture
PROHow image generators work, and how to treat what they make