ollama/x
Patrick Devine 82e0ddb6fe
mlxrunner: harden linear/embedding layers against over-promotion (#16682)
Adding/Multiplying a tensor by a scalar w/ a different data type
can cause the tensor to be promoted and cause performance issues.

This change adds several guards against over-promotion.
2026-06-11 13:56:25 -07:00
..
agent x/cmd: enable web search and web fetch with flag (#13690) 2026-01-12 13:59:40 -08:00
cmd Reapply "don't require pulling stubs for cloud models" again (#14608) 2026-03-06 14:27:47 -08:00
create mlx: "requires" in modelfile is being ignored for mlx based models (#16469) 2026-06-03 13:10:57 -07:00
imagegen llama-server followups (#16353) 2026-06-01 10:44:21 -07:00
internal/mlxthread mlxthread: preserve the original stack when worker work panics 2026-06-09 00:39:19 -07:00
mlxrunner mlxrunner: record committed MTP drafts before streaming them 2026-06-09 00:39:19 -07:00
models mlxrunner: harden linear/embedding layers against over-promotion (#16682) 2026-06-11 13:56:25 -07:00
safetensors mlx: Support NVIDIA TensorRT Model Optimizer import (#15566) 2026-04-27 18:28:10 -07:00
server mlx: fix reported information in ollama show (#16289) 2026-05-24 14:08:06 -07:00
tokenizer runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031) 2026-05-29 13:35:47 -07:00
tools add ability to disable cloud (#14221) 2026-02-12 15:47:00 -08:00
transfer mlx: refined model push behavior (#15431) 2026-05-08 14:25:30 -07:00