Ollama

Ollama is an open-source platform for running large language models (LLMs) locally on your personal machine. It works as a hub for downloading, updating, and managing local language models.

Running language models entirely on your hardware means that all data, prompts, code, and outputs can stay on your machine, with no internet or external servers required. This allows you to maintain full control and privacy. Ollama also provides an optional cloud service for running larger models on datacenter-grade hardware when local resources are limited.

Official website: ollama.com