AI Fundamentals
Token
The basic unit of text that AI models process. Roughly 1 token = 0.75 words or 4 characters in English. Code is less token-efficient than prose due to special characters and formatting. Pricing, context limits, and response times are all measured in tokens.