ollama/x/mlxrunner
Daniel Hiltgen 630882621b
llama-server followups (#16353)
* llama-server followups

Misc fixes for #16031
- Add back dropped ROCm build flag for multi-GPU support on windows
- Fix amdhip64_*.dll version detection for "latest" selection
- Fix embeddings API for consistent normalize behavior with prior versions

* ci: set up for automated llama.cpp update testing

* reduce batch for fa-disabled, and constrained vram

* mlx: fix v3 load bug on m5

Imagegen was incorrectly loading v3 first.  This DRYs out the loading code so imagegen gets the same new v4/v3 selection logic.

* fix reload bug on embedding models

* bump version

* steer user how to enable iGPU when disabled
2026-06-01 10:44:21 -07:00
..
batch mlxrunner: decouple models from attention cache storage layout 2026-04-27 20:04:46 -07:00
cache mlxrunner: keep gated-delta recurrent state in float32 2026-05-22 09:32:09 -07:00
mlx llama-server followups (#16353) 2026-06-01 10:44:21 -07:00
model Revert "mlxrunner: add DFlash speculative decoding (#16134)" 2026-05-22 09:32:09 -07:00
sample mlx: rework the MLX sampler (#16122) 2026-05-13 17:18:27 -07:00
cache.go Revert "mlxrunner: add DFlash speculative decoding (#16134)" 2026-05-22 09:32:09 -07:00
cache_test.go Revert "mlxrunner: add DFlash speculative decoding (#16134)" 2026-05-22 09:32:09 -07:00
cache_trie.go mlxrunner: share KV cache across conversations with common prefixes 2026-03-18 16:06:33 -07:00
cache_trie_test.go mlxrunner: share KV cache across conversations with common prefixes 2026-03-18 16:06:33 -07:00
client.go runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031) 2026-05-29 13:35:47 -07:00
imports.go Revert "mlxrunner: add DFlash speculative decoding (#16134)" 2026-05-22 09:32:09 -07:00
mtp.go mlx: rework the MLX sampler (#16122) 2026-05-13 17:18:27 -07:00
pipeline.go Revert "mlxrunner: add DFlash speculative decoding (#16134)" 2026-05-22 09:32:09 -07:00
runner.go runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031) 2026-05-29 13:35:47 -07:00
server.go mlx: rework the MLX sampler (#16122) 2026-05-13 17:18:27 -07:00
status_memory.go mlx: avoid status timeout during inference (#16086) 2026-05-11 16:03:38 -07:00
status_memory_test.go mlx: avoid status timeout during inference (#16086) 2026-05-11 16:03:38 -07:00
utf8_buffer.go consolidate the tokenizer (#14327) 2026-02-19 15:55:45 -08:00
utf8_buffer_test.go consolidate the tokenizer (#14327) 2026-02-19 15:55:45 -08:00