Commit graph

40 commits

Author SHA1 Message Date
J Berg
5632619189
Map disabled thinking to the models lowest supported level (#19684) 2026-11-12 15:03:07 -08:00
J Berg
361b3e17fd
Support deferred tool loading in claude code (#19578) 2026-11-12 13:24:56 -08:00
Daniel Hiltgen
f067033f91
mlx: add LFM3 and d1 models (#19333) 2026-10-27 08:47:18 -07:00
Jeffrey Morgan
675150d6ad
voice: add voice catalog for Phonon (#19242)
* mlxrunner: import and list Phonon catalog voices

* docs: document Phonon voices
2026-10-23 16:15:08 -07:00
Jeffrey Morgan
6ef847b8fe
mlxrunner: add Phonon text-to-speech support (#19166)
* mlxrunner: add Phonon text-to-speech support

Add Phonon text-to-speech through the existing MLX runner, with an
OpenAI-compatible speech endpoint and CLI playback.

Include model loading, text preprocessing, streaming audio, and
regression tests.

* docs: add speech models

* fix min version

---------

Co-authored-by: Daniel Hiltgen <daniel@ollama.com>
2026-10-22 11:36:42 -07:00
Devon Rifkin
2476d5ead1
docs: add model grouping to cloud usage (#19069)
* docs: add model grouping to cloud usage

Document group_by=model in the cloud usage guide and OpenAPI schema.
Explain group selection and remainder, and show responses with multiple
models across time buckets.

* Update docs/api/cloud-usage.mdx

Co-authored-by: Bruce MacDonald <brucewmacdonald@gmail.com>

---------

Co-authored-by: Bruce MacDonald <brucewmacdonald@gmail.com>
2026-10-16 16:01:01 -07:00
Jonathan Berg
370c9b6739 cleanup 2026-10-15 16:01:26 -07:00
Jonathan Berg
3d418367d9 clef cloud launch 2026-10-15 13:34:02 -07:00
Anna Rahn
33a3afa604 docs: changing model recs to Models page link, updating references to Ollamas cloud 2026-10-13 10:05:39 -07:00
Jeffrey Morgan
8583859ea6
Revert "docs: restructuring" (#18960) 2026-10-12 13:07:13 -07:00
Anna Rahn
db2635b54b standardizing language referring to cloud services 2026-10-08 15:12:00 -07:00
Anna Rahn
8d978f6874
Merge branch 'main' into docs_update 2026-10-07 12:24:17 -07:00
Anna Rahn
1f51984dc3 keeping old urls, updating model retirement page 2026-10-07 10:00:44 -07:00
Devon Rifkin
f864601538
server: proxy cloud usage and balance APIs (#18829)
Forward GET /api/usage and GET /api/balance through the local server
using the signed-in account.

Add API documentation and tests for proxying, signing, and
disabled cloud access.
2026-10-06 18:31:54 -07:00
Anna Rahn
266790cffe Merge remote-tracking branch 'origin/main' into docs_update
# Conflicts:
#	docs/api/introduction.mdx
#	docs/cloud.mdx
#	docs/docs.json
#	docs/guide/capabilities/decision.mdx
#	docs/index.mdx
#	docs/integrations/cline.mdx
#	docs/quickstart.mdx
2026-10-06 16:43:59 -07:00
Anna Rahn
cba2a9cd52 documentation re-structuring 2026-10-06 12:28:15 -07:00
Parth Sareen
1abe35e6e6
docs: document System One API (#18702) 2026-09-29 19:33:23 -07:00
Parth Sareen
c173758997
docs: document thinking control discovery (#18501) 2026-09-22 18:28:11 -07:00
Parth Sareen
38fdb5dd58
docs: refresh getting started guides (#18450) 2026-09-14 23:32:30 -07:00
Daniel Hiltgen
855f4bf989
Report cached prompt tokens (#17943)
* Report cached prompt tokens

Add prompt_eval_cached_count to native responses and expose equivalent cached-token fields through the OpenAI- and Anthropic-compatible APIs. Keep prompt_eval_count as the logical input total while excluding cache hits from CLI and benchmark prefill rates. Surface processed and cached prompt counts in benchmark output.

Collect cache counts from llama-server and MLX, preserve coherent metrics across two-pass structured generation.

Fixes #8008

Related to #15758

* review comments
2026-09-02 09:30:44 -07:00
Eva H
948f69330a
docs: fix broken links (#17676) 2026-08-11 14:36:39 -07:00
Jeffrey Morgan
4713800b08
imagegen: remove MLX image generation code (#16615)
Remove the x/imagegen tree (MLX image generation engine, Flux2/zimage
models, cache, C bindings) and all imagegen integration points:

- server: drop imagegen routes, scheduling, and generate handling
- api/cmd/docs: remove image generation API surface and docs
- middleware/openai: remove image endpoint support
- integration: remove imagegen test suites
- x/create: adopt the rewritten create pipeline from main; drop
  imagegen create path (CreateImageGenModel, IsTensorModelDir,
  model_index.json detection, Flux2KleinPipeline vision hack)
- retain x/imagegen/manifest (Ollama-store safetensors manifest
  loader), still used by x/mlxrunner and x/create/client
- fix Windows MLX dl.dll install, MLX CMake version path, and the
  show command after removing safetensors models
2026-07-28 15:35:28 -07:00
Eva H
d48d790baf
docs: redesign docs landing and integrations overview (#16807)
Co-authored-by: Parth Sareen <parth.sareen@ollama.com>
2026-06-24 16:28:28 -04:00
Parth Sareen
479e1cf94e
docs: document max think level (#16877) 2026-06-23 15:29:15 -07:00
Jeffrey Morgan
f0078ae476
docs: update docs examples to use Gemma 4 instead of Gemma 3 (#16607) 2026-06-07 12:43:13 -07:00
Cadu
81f4506a61
docs: document reasoning_effort support in OpenAI-compatible API (#14821)
Add reasoning_effort and reasoning to the supported features and
request fields for /v1/chat/completions. These fields control
thinking on thinking-capable models but were previously undocumented.

Closes #14820
2026-03-13 10:57:14 -07:00
Michael Yang
778899a5d2
docs: format compat docs (#14678) 2026-03-06 14:53:17 -08:00
Parth Sareen
5267d31d56
docs: ollama launch (#13852) 2026-01-23 23:18:50 -08:00
Jeffrey Morgan
634c416645
Add experimental image generation fields to /api/generate (#13753)
Request fields (experimental):
- width: image width (max 4096)
- height: image height (max 4096)
- steps: denoising steps
- seed: random seed

Response fields (experimental):
- images: base64-encoded generated images
- completed: current step progress
- total: total steps

Other changes:
- Fix lifecycle bug where image models wouldn't unload (refCount issue)
- Fix "headers already written" error on Ctrl+C during streaming
- Add gin middleware for OpenAI /v1/images/generations compatibility
- Update CLI to use /api/generate with progress bar
- Add preload support in interactive mode
2026-01-17 18:27:41 -08:00
Parth Sareen
b1a0db547b
docs: add env var needed for claude code in docs (#13721) 2026-01-15 10:11:00 -08:00
Parth Sareen
2b2cda7a2b
api: implement anthropic api (#13600)
* api: add Anthropic Messages API compatibility layer

Add middleware to support the Anthropic Messages API format at /v1/messages.
This enables tools like Claude Code to work with Ollama local and cloud models through the
Anthropic API interface.
2026-01-09 11:53:36 -08:00
lif
f5f74e12c1
docs: add version note for /v1/responses API (#13596)
Signed-off-by: majiayu000 <1835304752@qq.com>
2026-01-03 01:58:20 -05:00
Devon Rifkin
9f7822851c
docs: add docs for v1/responses and rework openai compat section (#13416)
* docs: add docs for v1/responses and rework openai compat section

I reworked the examples to be separated by topic and to be fully
runnable (i.e., they now log output instead of just suggesting how a
call might be made).

We now use `<CodeGroup>`s so that each example has a dropdown on the
docs site for users to choose, which makes the examples a lot more
digestible (since you only see approx 1/3 of the code you used to).

I also added a new tool to extract code examples into files so that it's
easier to actually run them and check that they work.

## Example

```shell
go run docs/tools/extract-examples/main.go docs/api/openai-compatibility.mdx
```

Output:

```
Extracting code examples to: /var/folders/vq/wfm2g6k917d3ldzpjdxc8ph00000gn/T/mdx-examples-3271754368

  - 01_basic.py
  - 01_basic.js
  - 01_basic.sh
  - 02_responses.py
  - 02_responses.js
  - 02_responses.sh
  - 03_vision.py
  - 03_vision.js
  - 03_vision.sh

Extracted 9 file(s) to /var/folders/vq/wfm2g6k917d3ldzpjdxc8ph00000gn/T/mdx-examples-3271754368

To run examples:

  cd /var/folders/vq/wfm2g6k917d3ldzpjdxc8ph00000gn/T/mdx-examples-3271754368
  npm install   # for JS examples

then run individual files with `node file.js`, `python file.py`, `bash file.sh`
```

In the future we should consider actually running the examples in CI and
having some sort of acceptance test so we can automatically detect when
our examples break. So this is just a start in that direction.

* Update docs/api/openai-compatibility.mdx

Co-authored-by: Parth Sareen <parth.sareen@ollama.com>

* Update docs/api/openai-compatibility.mdx

Co-authored-by: Parth Sareen <parth.sareen@ollama.com>

---------

Co-authored-by: Parth Sareen <parth.sareen@ollama.com>
2025-12-11 17:39:40 -08:00
Jeffrey Morgan
cb1cb06478
docs: rename api-reference.md back to api.md since redirect stopped working (#13056) 2025-11-11 15:53:06 -08:00
Jeffrey Morgan
93e45f0f0d
docs: temporarily restore api.md and cleanup docs paths (#12818) 2025-10-28 23:25:48 -07:00
Jeffrey Morgan
a342160803
docs: fix root api documentation page (#12813) 2025-10-28 19:17:54 -07:00
Parth Sareen
3d99d9779a
docs: add docs for docs.ollama.com (#12805) 2025-10-28 13:18:48 -07:00
Parth Sareen
6d02a43a75
docs: rename to mdx to setup docs site (#12804) 2025-10-28 13:04:31 -07:00
Parth Sareen
5483497d7a
Revert "docs: add reference to docs.ollama.com (#12800)" (#12803)
This reverts commit 934dd9e196.
2025-10-28 12:52:49 -07:00
Parth Sareen
934dd9e196
docs: add reference to docs.ollama.com (#12800) 2025-10-28 12:44:02 -07:00