Ollama

Ollama is the easiest way to run large language models locally. It packages model weights, configuration, and runtime into a single Modelfile. Supports hundreds of models including Llama, Qwen, Mistral, Gemma, and Phi. Provides an OpenAI-compatible API, GPU acceleration, and works on macOS, Linux, and Windows.