ollama/docs/api
Bruce MacDonald 6e65d95ef5
server: add cached eval metric to response
Added cached prompt token counts to Ollama responses and compatibility usage fields.

This carries local `llama-server` `cache_n` and MLX cache hits through `/api/generate`, `/api/chat`, OpenAI-compatible endpoints, and Anthropic-compatible `/v1/messages`. Cloud responses are passed through as-is, so cache counts will show up there once Cloud starts returning them.
2026-06-25 16:21:08 -07:00
..
anthropic-compatibility.mdx docs: format compat docs (#14678) 2026-03-06 14:53:17 -08:00
authentication.mdx docs: add docs for docs.ollama.com (#12805) 2025-10-28 13:18:48 -07:00
errors.mdx docs: update docs examples to use Gemma 4 instead of Gemma 3 (#16607) 2026-06-07 12:43:13 -07:00
introduction.mdx docs: redesign docs landing and integrations overview (#16807) 2026-06-24 16:28:28 -04:00
openai-compatibility.mdx docs: document max think level (#16877) 2026-06-23 15:29:15 -07:00
streaming.mdx docs: update docs examples to use Gemma 4 instead of Gemma 3 (#16607) 2026-06-07 12:43:13 -07:00
usage.mdx server: add cached eval metric to response 2026-06-25 16:21:08 -07:00