ollama/cmd
Daniel Hiltgen a00d083bb5
mlx: System one support (#18701)
* mlxrunner: restore System One scoring

Carry the MLX implementation and its tests from the original System One
commit. The API/compiler and llama-server implementation already exist on
the release branch, so retain those versions. Adapt the optional model test
to the renamed decision package and its explicit rendering/context setup.

(cherry picked from commit 26e546ddb3)

* Enable MLX System One and add regression coverage

* mlxrunner: add Laya support for System One

Import Laya checkpoints and implement bidirectional decision scoring.

* mlxrunner: release cached buffers after System One scoring

* decision: match Tev1 and Nimble publisher prompt formats

Select Tev1 prompts using renderer metadata and fix JSON formatting, with regression coverage for GGUF and MLX.

* mlx: support Clef and Clef Flash decision models

Add model import, quantization safeguards, and text/image scoring with the Clef joint decision head.

* support vision capabilities for decision models

* Make Clef scoring cancellable between prefill chunks

Preserve joint-head inputs and test cancellation, cleanup, and recovery.

* mlx: separate decision preparation and readout from forward

Let serial and batched scoring share model-owned preparation and readout
without duplicating architecture-specific logic in the runner.

* mlx: add Strands Decider support

* implement caching

---------

Co-authored-by: ParthSareen <parth.sareen@ollama.com>
2026-10-03 13:17:21 -07:00
..
bench bench: use HumanEval patch prompts (#17480) 2026-09-26 07:29:54 -07:00
config cli: add first-run onboarding shared with the desktop app (#18495) 2026-09-17 11:49:24 -07:00
internal/fileutil cmd: remove built-in agent (#18393) 2026-09-11 12:21:52 -07:00
launch launch: default Claude Code to client-side auto checks (#18596) 2026-09-23 15:20:45 -07:00
tui cli: add first-run onboarding shared with the desktop app (#18495) 2026-09-17 11:49:24 -07:00
cloud_suggest.go llama-server: prepare to remove compatibility patch 2026-09-24 19:25:52 -07:00
cloud_suggest_test.go Merge pull request #17483 from ollama/drifkin/suggest-cloud 2026-07-31 14:28:04 -07:00
cmd.go llama-server: prepare to remove compatibility patch 2026-09-24 19:25:52 -07:00
cmd_launcher_test.go launch: rename Codex App integration to ChatGPT (#17161) 2026-07-13 14:34:17 -07:00
cmd_test.go llama-server: prepare to remove compatibility patch 2026-09-24 19:25:52 -07:00
create_safetensors.go create: support explicit model capabilities (#18708) 2026-09-29 11:10:25 -07:00
create_safetensors_remote.go mlx: System one support (#18701) 2026-10-03 13:17:21 -07:00
create_safetensors_remote_test.go create: support explicit model capabilities (#18708) 2026-09-29 11:10:25 -07:00
create_safetensors_test.go create: support explicit model capabilities (#18708) 2026-09-29 11:10:25 -07:00
editor_unix.go feature: add ctrl-g to allow users to use an editor to edit their prompt (#14197) 2026-02-11 13:04:41 -08:00
editor_windows.go feature: add ctrl-g to allow users to use an editor to edit their prompt (#14197) 2026-02-11 13:04:41 -08:00
interactive.go llama-server: prepare to remove compatibility patch 2026-09-24 19:25:52 -07:00
interactive_test.go cmd: guard empty editor before indexing fields (#17067) 2026-08-24 09:50:40 -07:00
start.go nolintlint 2024-06-04 11:13:30 -07:00
start_darwin.go cmd: ollama launch improvements (#14099) 2026-02-05 15:08:17 -08:00
start_default.go lint 2024-08-01 17:06:06 -07:00
start_windows.go lint fixes (#17897) 2026-08-20 10:23:25 -07:00
warn_thinking_test.go llama-server: prepare to remove compatibility patch 2026-09-24 19:25:52 -07:00
welcome.go cli: add first-run onboarding shared with the desktop app (#18495) 2026-09-17 11:49:24 -07:00
welcome_test.go cli: add first-run onboarding shared with the desktop app (#18495) 2026-09-17 11:49:24 -07:00