07 · AI Fundamentals Lab
When a model reads a word, which other words is it looking at?
Tap any word in a sentence and the words it leans on light up. You will see how a model works out who “she” is, how it connects a subject to a verb ten words later, and why the same six words in a different order mean something else entirely.
The spotlight
Pick a sentence, then tap a word. Every earlier word is shaded by how much that word is being leaned on. Darker means more weight.
The whole grid at once
One row per word. Read a row left to right: that is everything the word at the start of the row is paying attention to.
Attention is not one thing
A real model runs dozens of these at once, in parallel, at every layer. Each one is called a head, and different heads end up chasing different patterns. Here are three, all looking at the same word.
Guided experiments
Three short ones. Commit to an answer before you reveal it.
My observations
Kept in this browser tab only, for this session.