mirror of
https://github.com/ollama/ollama.git
synced 2026-10-20 18:41:17 +00:00
98acec40ae
* create: add server-side MLX imports and drop GGUF conversion Support safetensors imports through the MLX create pipeline both locally and on the server, including remote upload/staging, draft layer handling, cancellation propagation, transfer limits, and shared manifest/blob writing. Limit GGUF create to wrapping existing GGUF inputs into Ollama manifests. Remove the in-tree safetensors-to-GGUF converter, server quantization path, and converter-only dependencies so GGUF conversion and quantization stay in llama.cpp tooling. Keep the MLX path focused on supported safetensors model creation with validation before MLX work, and expose that flow without the --experimental CLI gate. * address comments * add client side gguf create fast path * address comments * rebase adjustments
85 lines
2.8 KiB
Text
85 lines
2.8 KiB
Text
---
|
|
title: Importing a Model
|
|
---
|
|
|
|
## Table of Contents
|
|
|
|
- [Importing a Safetensors model](#importing-a-model-from-safetensors-weights)
|
|
- [Importing a GGUF model](#importing-a-gguf-model)
|
|
- [Sharing models on ollama.com](#sharing-your-model-on-ollama-com)
|
|
|
|
## Importing a model from Safetensors weights
|
|
|
|
First, create a `Modelfile` with a `FROM` command which points to the directory containing your Safetensors weights:
|
|
|
|
```dockerfile
|
|
FROM /path/to/safetensors/directory
|
|
```
|
|
|
|
If you create the Modelfile in the same directory as the weights, you can use the command `FROM .`.
|
|
|
|
Now run the `ollama create` command from the directory where you created the `Modelfile`:
|
|
|
|
```shell
|
|
ollama create my-model
|
|
```
|
|
|
|
Lastly, test the model:
|
|
|
|
```shell
|
|
ollama run my-model
|
|
```
|
|
|
|
## Importing a GGUF model
|
|
|
|
Ollama does not quantize GGUF models during import. Prepare and quantize them first with a GGUF tool such as llama.cpp's [`llama-quantize`](https://github.com/ggml-org/llama.cpp/tree/master/tools/quantize).
|
|
|
|
To import a single-file GGUF model, create a `Modelfile` containing:
|
|
|
|
```dockerfile
|
|
FROM /path/to/file.gguf
|
|
```
|
|
|
|
For a split GGUF model, keep the original split filenames and use a wildcard that matches every shard.
|
|
|
|
```dockerfile
|
|
FROM /path/to/model-*.gguf
|
|
```
|
|
|
|
Once you have created your `Modelfile`, use the `ollama create` command to build the model.
|
|
|
|
```shell
|
|
ollama create my-model
|
|
```
|
|
|
|
## Sharing your model on ollama.com
|
|
|
|
You can share any model you have created by pushing it to [ollama.com](https://ollama.com) so that other users can try it out.
|
|
|
|
First, use your browser to go to the [Ollama Sign-Up](https://ollama.com/signup) page. If you already have an account, you can skip this step.
|
|
|
|
<img src="images/signup.png" alt="Sign-Up" width="40%" />
|
|
|
|
The `Username` field will be used as part of your model's name (e.g. `jmorganca/mymodel`), so make sure you are comfortable with the username that you have selected.
|
|
|
|
Now that you have created an account and are signed-in, go to the [Ollama Keys Settings](https://ollama.com/settings/keys) page.
|
|
|
|
Follow the directions on the page to determine where your Ollama Public Key is located.
|
|
|
|
<img src="images/ollama-keys.png" alt="Ollama Keys" width="80%" />
|
|
|
|
Click on the `Add Ollama Public Key` button, and copy and paste the contents of your Ollama Public Key into the text field.
|
|
|
|
To push a model to [ollama.com](https://ollama.com), first make sure that it is named correctly with your username. You may have to use the `ollama cp` command to copy
|
|
your model to give it the correct name. Once you're happy with your model's name, use the `ollama push` command to push it to [ollama.com](https://ollama.com).
|
|
|
|
```shell
|
|
ollama cp mymodel myuser/mymodel
|
|
ollama push myuser/mymodel
|
|
```
|
|
|
|
Once your model has been pushed, other users can pull and run it by using the command:
|
|
|
|
```shell
|
|
ollama run myuser/mymodel
|
|
```
|