Ollama

An open-source tool that makes it easy to download and run large language models locally on macOS, Linux, or Windows. Ollama manages model downloads, serves a local API, and supports popular open-weight models like Llama and Mistral.