ollama/create
Daniel Hiltgen 2c73164246
nemotron_h: add MLX vision support (#17714)
* nemotron_h: add MLX vision support

Implement the RADIO vision encoder and projector on the shared MLX media pipeline, including dynamic-resolution preprocessing, deterministic placeholder expansion, chunked feature scattering, and MTP offsets.

Expose source-advertised Nemotron vision while continuing to suppress unsupported audio, and preserve both modality towers at source precision during create.

Harden Nemotron streaming parser termination and add focused coverage for vision configuration, media placement, capability reporting, and tool-call parsing.

* review comments

* address comments
2026-09-17 16:29:14 -07:00
..
blockfp8.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
blockfp8_test.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
classify.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
classify_test.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
cohere2moe.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
create.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
create_test.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
draft.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
draft_test.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
gemma4.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
gemma4_test.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
glimmer.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
glimmer_test.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
inventory.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
inventory_test.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
laguna.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
laguna_test.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
manifest.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
manifest_test.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
metadata.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
metadata_test.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
mlxthread.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
nemotron_h.go nemotron_h: add MLX vision support (#17714) 2026-09-17 16:29:14 -07:00
nemotron_h_test.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
pipeline.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
pipeline_test.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
plan.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
plan_test.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
prequant.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
prequant_test.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
quantize.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
quantpolicy.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
qwen4_exp.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
qwen4_exp_test.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
qwen35.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
transform.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
verify.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
verify_test.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
writer.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00
writer_test.go mlx, mlxrunner: move the MLX engine out of x/ 2026-09-16 14:06:08 -07:00