Ollama

Domain: Models & Providers

Motivation

A tool for running LLMs locally. Easy installation. Supports many open-source models.

Concrete Example

Install Ollama. Run: ollama run llama3.3. Model runs on your machine. hermes model add local —base-url http://localhost:11434/v1. Hermes uses it.

Analogy

A personal coffee machine - you make coffee at home. Ollama runs LLMs at home, on your machine.