ollama/x/imagegen/cmd/engine
Daniel Hiltgen 630882621b
llama-server followups (#16353)
* llama-server followups

Misc fixes for #16031
- Add back dropped ROCm build flag for multi-GPU support on windows
- Fix amdhip64_*.dll version detection for "latest" selection
- Fix embeddings API for consistent normalize behavior with prior versions

* ci: set up for automated llama.cpp update testing

* reduce batch for fa-disabled, and constrained vram

* mlx: fix v3 load bug on m5

Imagegen was incorrectly loading v3 first.  This DRYs out the loading code so imagegen gets the same new v4/v3 selection logic.

* fix reload bug on embedding models

* bump version

* steer user how to enable iGPU when disabled
2026-06-01 10:44:21 -07:00
..
generate.go runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031) 2026-05-29 13:35:47 -07:00
image.go runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031) 2026-05-29 13:35:47 -07:00
main.go llama-server followups (#16353) 2026-06-01 10:44:21 -07:00
README.md MLX: add header vendoring and remove go build tag (#14642) 2026-03-09 17:24:45 -07:00
sample.go MLX: add header vendoring and remove go build tag (#14642) 2026-03-09 17:24:45 -07:00

MLX Engine

Experimental MLX backend for running models on Apple Silicon and CUDA.

Build

go build -o engine ./x/imagegen/cmd/engine

Text Generation

Text generation models are no longer supported by this engine.

Image Generation

./engine -zimage -model /path/to/z-image -prompt "a cat" -output cat.png

Options:

  • -width, -height - image dimensions (default 1024x1024)
  • -steps - denoising steps (default 9)
  • -seed - random seed (default 42)