How do large language models actually generate code?

LLMs generate code by predicting the most likely next token based on patterns learned from billions of lines of code during training. They don't "understand" code the way humans do — they recognize statistical relationships between tokens. When you provide a prompt, the model samples from a probability distribution to produce output that statistically resembles correct code for your context.