Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. https://ollama.com
Find a file
Daniel Hiltgen 2bd4d6aabd
mlx: fuse Inkling residual mixing on Metal (#19808)
Compute the normalized residuals, query scores, and weighted sum in one
dispatch. Keep intermediate values in the threadgroup and preserve the
existing reduction order and rounding.
2026-11-20 20:05:50 -08:00
.github cmake: support compatible binary MLX-C and XGrammar (#19688) 2026-11-16 07:11:09 -08:00
anthropic Support deferred tool loading in claude code (#19578) 2026-11-12 13:24:56 -08:00
api api: preserve unmodeled tool schema keywords (#19686) 2026-11-13 16:00:07 -08:00
app app: make ChatGPT disconnect failures retryable (#19336) 2026-10-30 17:34:24 -04:00
auth auth: fix problems with the ollama keypairs (#12373) 2025-09-22 23:20:20 -07:00
cmake cmake: support compatible binary MLX-C and XGrammar (#19688) 2026-11-16 07:11:09 -08:00
cmd cmd: omit bias and gamma vectors from verbose safetensors show (#19803) 2026-11-20 14:44:24 -08:00
compatmigrate llama-server: prepare to remove compatibility patch 2026-09-24 19:25:52 -07:00
create mlxrunner: add Inkling 2 Mini (#19799) 2026-11-20 18:38:44 -08:00
decision Add AutoTrust decision model to MLX (#19399) 2026-11-04 09:47:37 -08:00
discover mlxrunner: adapt saved history to memory pressure (#19678) 2026-11-19 15:41:42 -08:00
docs install: support preview channel (#19801) 2026-11-20 14:47:25 -08:00
envconfig mlxrunner: choose default parallelism from available memory (#19785) 2026-11-20 07:13:42 -08:00
format chore(all): replace instances of interface with any (#10067) 2025-04-02 09:44:27 -07:00
fs MLX: make Qwen3.8 Flash Next memory efficient (#18078) 2026-11-06 13:39:21 -08:00
harmony parsers: report the strings that end a response's thinking 2026-09-22 11:24:11 -07:00
integration mlxrunner: add Inkling 2 Mini (#19799) 2026-11-20 18:38:44 -08:00
internal cmd/launch: show gateway model names in Claude Desktop's model picker (#19533) 2026-11-05 10:40:54 -08:00
llama llama.cpp: version bump b12257 (#19646) 2026-11-10 13:41:48 -08:00
llm mlxrunner: add Inkling 2 Mini (#19799) 2026-11-20 18:38:44 -08:00
logutil runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031) 2026-05-29 13:35:47 -07:00
manifest server: reuse verified manifests and loaded models in inference routes (#18947) 2026-10-12 08:41:52 -07:00
middleware Support deferred tool loading in claude code (#19578) 2026-11-12 13:24:56 -08:00
ml tokenizer, ml: remove dead code 2026-09-16 14:06:08 -07:00
mlx mlx: fuse Inkling residual mixing on Metal (#19808) 2026-11-20 20:05:50 -08:00
mlxrunner mlx: inkling follow up (#19806) 2026-11-20 19:03:47 -08:00
model mlx: inkling follow up (#19806) 2026-11-20 19:03:47 -08:00
openai openai: return an empty array for /v1/models when no models are installed (#19539) 2026-11-05 16:57:40 -08:00
parser create: support explicit model capabilities (#18708) 2026-09-29 11:10:25 -07:00
progress tokenizer, ml: remove dead code 2026-09-16 14:06:08 -07:00
readline lint fixes (#17897) 2026-08-20 10:23:25 -07:00
scripts install: support preview channel (#19801) 2026-11-20 14:47:25 -08:00
server mlx: inkling follow up (#19806) 2026-11-20 19:03:47 -08:00
template create: add server-side MLX imports and drop GGUF conversion (#14969) 2026-09-14 20:32:36 -07:00
thinking create: add server-side MLX imports and drop GGUF conversion (#14969) 2026-09-14 20:32:36 -07:00
tools tools: ignore braces inside JSON strings when detecting tool call end (#16937) 2026-06-27 12:00:55 -07:00
transfer transfer: support proxies on registry redirect targets (#19065) 2026-10-16 15:00:17 -07:00
types mlxrunner: add Inkling 2 Mini (#19799) 2026-11-20 18:38:44 -08:00
version add version 2023-08-22 09:40:58 -07:00
.dockerignore next build (#8539) 2025-01-29 15:03:38 -08:00
.gitattributes mlxrunner: add Inkling 2 Mini (#19799) 2026-11-20 18:38:44 -08:00
.gitignore create: Clean up experimental paths, fix create from existing safetensor model (#14679) 2026-04-07 08:12:57 -07:00
.golangci.yaml mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
AGENTS.md Add AGENTS.md and CLAUDE.md to root repository (#16604) 2026-06-07 10:57:59 -07:00
CLAUDE.md Add AGENTS.md and CLAUDE.md to root repository (#16604) 2026-06-07 10:57:59 -07:00
CMakeLists.txt mlx: fix mac assumptions on linux/windows (#17898) 2026-08-20 09:50:10 -07:00
CMakePresets.json runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031) 2026-05-29 13:35:47 -07:00
CONTRIBUTING.md docs: fix typos in repository documentation (#10683) 2025-11-15 20:22:29 -08:00
Dockerfile ci: harden download steps with retries (#18883) 2026-10-13 09:39:06 -07:00
go.mod launch: use allocated context for OpenCode (#19193) 2026-10-23 11:45:15 -07:00
go.sum build: update jsonparser to v1.1.2 (#19220) 2026-10-22 11:15:33 -07:00
LICENSE
LLAMA_CPP_VERSION llama.cpp: version bump b12257 (#19646) 2026-11-10 13:41:48 -08:00
main.go
MLX_C_VERSION MLX, MLX-C: version bump (#19647) 2026-11-10 13:42:11 -08:00
MLX_VERSION MLX, MLX-C: version bump (#19647) 2026-11-10 13:42:11 -08:00
README.md README: add Quock to Mobile community integrations (#19361) 2026-11-06 12:41:45 -08:00
SECURITY.md docs: update SECURITY.md 2026-10-12 13:27:55 -07:00

ollama

Ollama

Start building with open models. Access the latest releases locally or in the cloud with complete privacy.

Download

macOS

curl -fsSL https://ollama.com/install.sh | sh

or download manually

Windows

irm https://ollama.com/install.ps1 | iex

or download manually

Linux

curl -fsSL https://ollama.com/install.sh | sh

Manual install instructions

Docker

The official Ollama Docker image ollama/ollama is available on Docker Hub.

Libraries

Community

Get started

ollama

You'll be prompted to run a model or connect Ollama to your existing agents or applications such as Claude Code, OpenClaw, OpenCode , Codex, Copilot, and more.

Coding

To launch a specific integration:

ollama launch claude

Supported integrations include Claude Code, Codex, Copilot CLI, DeepSeek Harness, Droid, and OpenCode.

AI assistant

Use OpenClaw to turn Ollama into a personal AI assistant across WhatsApp, Telegram, Slack, Discord, and more:

ollama launch openclaw

Chat with a model

Run and chat with Gemma 4:

ollama run gemma4

See ollama.com/library for the full list.

See the quickstart guide for more details.

REST API

Ollama has a REST API for running and managing models.

curl http://localhost:11434/api/chat -d '{
  "model": "gemma4",
  "messages": [{
    "role": "user",
    "content": "Why is the sky blue?"
  }],
  "stream": false
}'

See the API documentation for all endpoints.

Python

pip install ollama
from ollama import chat

response = chat(model='gemma4', messages=[
  {
    'role': 'user',
    'content': 'Why is the sky blue?',
  },
])
print(response.message.content)

JavaScript

npm i ollama
import ollama from "ollama";

const response = await ollama.chat({
  model: "gemma4",
  messages: [{ role: "user", content: "Why is the sky blue?" }],
});
console.log(response.message.content);

Supported backends

  • llama.cpp project founded by Georgi Gerganov.

Documentation

Community Integrations

Want to add your project? Open a pull request.

Chat Interfaces

Web

Desktop

  • Dify.AI - LLM app development platform
  • AnythingLLM - All-in-one AI app for Mac, Windows, and Linux
  • Maid - Cross-platform mobile and desktop client
  • Witsy - AI desktop app for Mac, Windows, and Linux
  • Cherry Studio - Multi-provider desktop client
  • Ollama App - Multi-platform client for desktop and mobile
  • PyGPT - AI desktop assistant for Linux, Windows, and Mac
  • Alpaca - GTK4 client for Linux and macOS
  • SwiftChat - Cross-platform including iOS, Android, and Apple Vision Pro
  • Enchanted - Native macOS and iOS client
  • RWKV-Runner - Multi-model desktop runner
  • Ollama Grid Search - Evaluate and compare models
  • macai - macOS client for Ollama and ChatGPT
  • AI Studio - Multi-provider desktop IDE
  • Reins - Parameter tuning and reasoning model support
  • ConfiChat - Privacy-focused with optional encryption
  • LLocal.in - Electron desktop client
  • MindMac - AI chat client for Mac
  • Msty - Multi-model desktop client
  • BoltAI for Mac - AI chat client for Mac
  • IntelliBar - AI-powered assistant for macOS
  • Kerlig AI - AI writing assistant for macOS
  • Hillnote - Markdown-first AI workspace
  • Perfect Memory AI - Productivity AI personalized by screen and meeting history

Mobile

SwiftChat, Enchanted, Maid, Ollama App, Reins, and ConfiChat listed above also support mobile platforms.

Code Editors & Development

Libraries & SDKs

Frameworks & Agents

RAG & Knowledge Bases

  • RAGFlow - RAG engine based on deep document understanding
  • R2R - Open-source RAG engine
  • MaxKB - Ready-to-use RAG chatbot
  • Minima - On-premises or fully local RAG
  • Chipper - AI interface with Haystack RAG
  • ARGO - RAG and deep research on Mac/Windows/Linux
  • Archyve - RAG-enabling document library
  • Casibase - AI knowledge base with RAG and SSO
  • BrainSoup - Native client with RAG and multi-agent automation

Bots & Messaging

Terminal & CLI

Productivity & Apps

Observability & Monitoring

  • Opik - Debug, evaluate, and monitor LLM applications
  • OpenLIT - OpenTelemetry-native monitoring for Ollama and GPUs
  • Lunary - LLM observability with analytics and PII masking
  • Langfuse - Open source LLM observability
  • HoneyHive - AI observability and evaluation for agents
  • MLflow Tracing - Open source LLM observability

Database & Embeddings

Infrastructure & Deployment

Cloud

Package Managers