⚙️ Under the hood
Token
tokens, Tokens
The units a language model splits text into: whole words, word pieces or punctuation. Models read, compute and charge in tokens.
💭 Imagine …
LEGO bricks of language: common words are one brick, rare ones are built from several.
🔎 Example
“Coffeemaker” may become “Coffee” + “maker”. German usually needs more tokens than English for the same content.
🎯 Why it matters
Context windows, cost and speed are all measured in tokens.
🎓 Prefer step by step?
The AI Literacy course: 6 short modules with quizzes, a solid foundation in about 60 minutes.