ollama/template
Daniel Hiltgen 98acec40ae
create: add server-side MLX imports and drop GGUF conversion (#14969)
* create: add server-side MLX imports and drop GGUF conversion

Support safetensors imports through the MLX create pipeline both locally and on the server, including remote upload/staging, draft layer handling, cancellation propagation, transfer limits, and shared manifest/blob writing.

Limit GGUF create to wrapping existing GGUF inputs into Ollama manifests. Remove the in-tree safetensors-to-GGUF converter, server quantization path, and converter-only dependencies so GGUF conversion and quantization stay in llama.cpp tooling.

Keep the MLX path focused on supported safetensors model creation with validation before MLX work, and expose that flow without the --experimental CLI gate.

* address comments

* add client side gguf create fast path

* address comments

* rebase adjustments
2026-09-14 20:32:36 -07:00
..
testdata templates: add autotemplate for gemma3 (#9880) 2025-03-20 00:15:30 -07:00
alfred.gotmpl update templates to use messages 2024-08-27 15:44:04 -07:00
alfred.json autodetect stop parameters from template 2024-07-12 16:01:23 -07:00
alpaca.gotmpl update templates to use messages 2024-08-27 15:44:04 -07:00
alpaca.json autodetect stop parameters from template 2024-07-12 16:01:23 -07:00
chatml.gotmpl update templates to use messages 2024-08-27 15:44:04 -07:00
chatml.json autodetect stop parameters from template 2024-07-12 16:01:23 -07:00
chatqa.gotmpl update templates to use messages 2024-08-27 15:44:04 -07:00
chatqa.json autodetect stop parameters from template 2024-07-12 16:01:23 -07:00
codellama-70b-instruct.gotmpl update templates to use messages 2024-08-27 15:44:04 -07:00
codellama-70b-instruct.json autodetect stop parameters from template 2024-07-12 16:01:23 -07:00
command-r.gotmpl convert: import support for command-r models from safetensors (#6063) 2025-01-15 16:31:22 -08:00
command-r.json convert: import support for command-r models from safetensors (#6063) 2025-01-15 16:31:22 -08:00
falcon-instruct.gotmpl update templates to use messages 2024-08-27 15:44:04 -07:00
falcon-instruct.json autodetect stop parameters from template 2024-07-12 16:01:23 -07:00
gemma-instruct.gotmpl update templates to use messages 2024-08-27 15:44:04 -07:00
gemma-instruct.json autodetect stop parameters from template 2024-07-12 16:01:23 -07:00
gemma3-instruct.gotmpl templates: add autotemplate for gemma3 (#9880) 2025-03-20 00:15:30 -07:00
gemma3-instruct.json templates: add autotemplate for gemma3 (#9880) 2025-03-20 00:15:30 -07:00
granite-instruct.gotmpl update templates to use messages 2024-08-27 15:44:04 -07:00
granite-instruct.json autodetect stop parameters from template 2024-07-12 16:01:23 -07:00
index.json templates: add autotemplate for gemma3 (#9880) 2025-03-20 00:15:30 -07:00
llama2-chat.gotmpl update templates to use messages 2024-08-27 15:44:04 -07:00
llama2-chat.json autodetect stop parameters from template 2024-07-12 16:01:23 -07:00
llama3-instruct.gotmpl update templates to use messages 2024-08-27 15:44:04 -07:00
llama3-instruct.json autodetect stop parameters from template 2024-07-12 16:01:23 -07:00
magicoder.gotmpl update templates to use messages 2024-08-27 15:44:04 -07:00
magicoder.json autodetect stop parameters from template 2024-07-12 16:01:23 -07:00
mistral-instruct.gotmpl update templates to use messages 2024-08-27 15:44:04 -07:00
mistral-instruct.json autodetect stop parameters from template 2024-07-12 16:01:23 -07:00
openchat.gotmpl update templates to use messages 2024-08-27 15:44:04 -07:00
openchat.json autodetect stop parameters from template 2024-07-12 16:01:23 -07:00
phi-3.gotmpl update templates to use messages 2024-08-27 15:44:04 -07:00
phi-3.json autodetect stop parameters from template 2024-07-12 16:01:23 -07:00
solar-instruct.gotmpl update templates to use messages 2024-08-27 15:44:04 -07:00
solar-instruct.json autodetect stop parameters from template 2024-07-12 16:01:23 -07:00
starcoder2-instruct.gotmpl update templates to use messages 2024-08-27 15:44:04 -07:00
starcoder2-instruct.json autodetect stop parameters from template 2024-07-12 16:01:23 -07:00
template.go lint fixes (#17897) 2026-08-20 10:23:25 -07:00
template_test.go create: add server-side MLX imports and drop GGUF conversion (#14969) 2026-09-14 20:32:36 -07:00
vicuna.gotmpl update templates to use messages 2024-08-27 15:44:04 -07:00
vicuna.json autodetect stop parameters from template 2024-07-12 16:01:23 -07:00
zephyr.gotmpl update templates to use messages 2024-08-27 15:44:04 -07:00
zephyr.json autodetect stop parameters from template 2024-07-12 16:01:23 -07:00