Your sentence,
inside the machine.
Type anything. Then scroll. Watch it get cut, mapped, lit, stacked and rolled — the way a language model does it. Five minutes, no sign-up.
Try: · up to 14 words
- you
- tokens
- embeddings
- attention
- layers
- sampling
- play
Go deeper, one station at a time
Each station above opens into a 3–8 minute lesson: you guess first, you play the model's part, you say it back, then you try it for real on a free tier from the directory. No sign-up; progress stays in your browser.
Today's question
One question a day, the same for everyone.
Series
Why does ChatGPT do that?Eight mysteries, solved: you can explain to a friend why it answers at all — and why it sometimes makes things up.
8 of 22 lessons live
tokens
- Why does it miscount the r’s in "strawberry"?
Tokens · Beginner · 3 min
- Why does it forget what I said 20 messages ago?
Context window · Beginner · 3 min
- Why does the free tier say 429?
Rate limits (RPM, TPM, RPD) · Builder · 5 min
- How does it read a picture?
Vision: images as tokens · Builder · 5 min
- Why is the second call cheaper?
Prompt caching · Builder · 5 min
- Why does the model ignore my instructions?
System prompts and instruction priority · Beginner · 5 min
embeddings
- How does it know "king" is close to "queen"?
Embeddings · Beginner · 5 min
- Teach it my docs, or let it read them?
RAG vs fine-tuning · Builder · 5 min
attention
- How does it know what "it" refers to?
Self-attention · Beginner · 5 min
layers
- What's inside the box?
The Transformer · Builder · 5 min
- How did it learn all this?
Training: loss and gradient descent · Builder · 8 min
- Why is it so polite (and so cautious)?
RLHF · Builder · 5 min
- Why does the free model feel dumber?
Model size, free vs paid tiers · Beginner · 5 min
- How does a 30 GB model fit on my laptop?
Quantization (bits per weight) · Builder · 5 min
sampling
- Does it plan what it's going to say?
Next-token prediction · Beginner · 3 min
- Why does the same prompt give different answers?
Temperature and sampling · Beginner · 3 min
- Why does it invent sources that don't exist?
Hallucination · Beginner · 3 min
- Why does it ‘think’ before answering?
Reasoning (thinking) models · Builder · 5 min
- Why does it break my JSON?
Structured output (constrained decoding) · Builder · 5 min
- How does AI draw a picture from noise?
Diffusion (denoising image models) · Beginner · 5 min
play
- What’s an "agent", and why is everyone saying it?
Agents and MCP · Builder · 5 min
- Why can a web page hijack my AI agent?
Prompt injection · Builder · 5 min