🔒

Pro Lab

Self-Attention from Scratch

The one mechanism behind every transformer, built from nothing but dot products and a softmax. Five words each emit a query, a key, and a value; watch the attention matrix light up as each word decides who to listen to, and drag the temperature to feel why we scale by √dₖ.

🎬 Free preview in EN / हिं / ES — watch it, then unlock the lab to try it yourself.

Start 30 days free → Try 34 free labs No card needed · cancel anytime Already Pro? Log in