mirror of
https://github.com/ollama/ollama.git
synced 2026-07-10 09:44:18 +00:00
505e35f2b9
The heuristic schedule grew the draft toward a fixed cap on acceptance alone, maximizing accepted-tokens-per-step rather than throughput, and on a steep-forward target it regressed below no speculation. Replace it with an engine-level controller that drafts the depth maximizing committed-tokens-per-wallclock from live per-position acceptance and persisted per-width forward cost, with no draft-length cap; the heuristic schedule and the OLLAMA_MLX_MTP_* env vars go with it. |
||
|---|---|---|
| .. | ||
| base | ||
| embedding.go | ||
| embedding_test.go | ||
| linear.go | ||
| quant.go | ||
| root.go | ||