Skip to content
World 2 · Paying Attention · 12 min · PRO

Query, key, value

How attention scores are computed

PRO · How AI Works

World 2: Paying Attention is part of PRO

The first world of How AI Works is free. PRO opens the other 24 lessons in 6 worlds — simulations, quizzes and all.

  • The word “it”
  • Many heads, many layers
  • Order and masks
  • From scores to odds
  • Temperature
PRO includes
  • All 60 labs — every world, every lesson
  • Practice exams and certificates

$8.33/mo, billed yearly ($99.99) · or $39.99 monthly

Unlock How AI WorksTry the free world
My notes
Only saved in this browserAll my notes →
← The word “it”Many heads, many layers →

Report a mistake

What is wrong?
0 / 2000 · at least 10 characters
Sent along with your report
  • Page
  • About Query, key, value — How AI Works · llm/query-key-value
Plus your browser type. Reports go to our support system; see the privacy notice.