Attention Lens

Five case files, each a sentence where one word decides what "it" means. Interrogate twelve attention heads across three layers: some look at the previous word, some at the verb, one grabs the nearest noun, and one reads the clue. Name the suspect, then pick out the head that knew. The workbench lets you drag query and key vectors and watch softmax turn dot products into attention.

← LabLab blogHome