CERBERUS/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-10-21 19:11:17 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4
ollama/server
History
Exact
Daniel Hiltgen d9dec1509d
Reduce model lookup and MLX decision request overhead (#18806) 
* Reduce model lookup and MLX decision request overhead

Avoid decoding unrelated manifests when resolving existing model names.
Reuse small Metal scratch buffers between decision requests, releasing
larger working sets and clearing scratch after scoring errors.

* address comments
2026-10-05 17:34:41 -07:00
..
auth.go
auth_test.go
capabilities_test.go mlx: System one support (#18701) 2026-10-03 13:17:21 -07:00
cloud_proxy.go openai: support web search in Responses API (#17686) 2026-08-12 11:51:54 -07:00
cloud_proxy_test.go cloud_proxy: for the web_search legacy path, flush on newlines (#14897) 2026-03-17 13:30:17 -07:00
codex_proxy.go app: add Ollama to ChatGPT Desktop (#18236) 2026-09-04 14:04:48 -07:00
codex_proxy_test.go app: harden Codex desktop proxy handling (#18244) 2026-09-04 17:48:55 -07:00
create.go mlx: System one support (#18701) 2026-10-03 13:17:21 -07:00
create_fuzz_test.go create: add server-side MLX imports and drop GGUF conversion (#14969) 2026-09-14 20:32:36 -07:00
create_split_gguf.go create: add server-side MLX imports and drop GGUF conversion (#14969) 2026-09-14 20:32:36 -07:00
create_test.go mlx: System one support (#18701) 2026-10-03 13:17:21 -07:00
download.go mlx: bound pull stall retries and let the watchdog interrupt them (#18625) 2026-09-28 13:31:38 -07:00
download_test.go mlx: bound pull stall retries and let the watchdog interrupt them (#18625) 2026-09-28 13:31:38 -07:00
fixblobs.go
fixblobs_test.go
gemma4_test.go models: add support for gemma4-12b (#16457) 2026-06-03 07:44:57 -07:00
gguf_metadata.go llama-server: prepare to remove compatibility patch 2026-09-24 19:25:52 -07:00
gguf_metadata_test.go tests: fix metadata deletion test flake (#18493) 2026-09-17 16:39:42 -07:00
glimmer_images_test.go Release v0.32.7 (#17646) 2026-08-10 04:04:56 -07:00
images.go pull: allow RCs to pull matching min_version (#18790) 2026-10-04 16:15:37 -07:00
images_test.go pull: allow RCs to pull matching min_version (#18790) 2026-10-04 16:15:37 -07:00
inference_request_log.go add ability to turn on debug request logging (#14106) 2026-03-19 17:08:17 -07:00
logprob.go
model.go llama-server: prepare to remove compatibility patch 2026-09-24 19:25:52 -07:00
model_caches.go server: extract GGUF metadata and unify capabilities (#17858) 2026-09-10 11:16:37 -07:00
model_list.go mlx: System one support (#18701) 2026-10-03 13:17:21 -07:00
model_list_test.go nemotron_h: add MLX vision support (#17714) 2026-09-17 16:29:14 -07:00
model_recommendations.go app: add Ollama to ChatGPT Desktop (#18236) 2026-09-04 14:04:48 -07:00
model_recommendations_test.go app: add Ollama to ChatGPT Desktop (#18236) 2026-09-04 14:04:48 -07:00
model_resolver.go llama-server: prepare to remove compatibility patch 2026-09-24 19:25:52 -07:00
model_resolver_test.go Reapply "don't require pulling stubs for cloud models" again (#14608) 2026-03-06 14:27:47 -08:00
model_show_cache.go llama-server: prepare to remove compatibility patch 2026-09-24 19:25:52 -07:00
model_show_cache_test.go llama-server: prepare to remove compatibility patch 2026-09-24 19:25:52 -07:00
model_thinking.go api: expose model thinking levels and defaults (#18473) 2026-09-18 14:10:53 -07:00
model_thinking_test.go api: expose model thinking levels and defaults (#18473) 2026-09-18 14:10:53 -07:00
prompt.go server: align generate with native chat templates (#16878) 2026-06-24 13:43:56 -07:00
prompt_test.go anthropic: Preserve Claude local image-path tool results in renderer-owned prompt formatting (#16047) 2026-05-12 00:02:17 -04:00
renderer_resolution.go gemma4: image and audio input support 2026-09-02 15:07:28 -07:00
responses_compact.go server/openai: retry compaction after context overflow (#18324) 2026-09-08 14:42:03 -07:00
responses_compact_test.go openai: support standalone named function outputs (#18348) 2026-09-09 14:51:50 -07:00
routes.go Reduce model lookup and MLX decision request overhead (#18806) 2026-10-05 17:34:41 -07:00
routes_cloud_test.go llama-server: prepare to remove compatibility patch 2026-09-24 19:25:52 -07:00
routes_create_test.go Merge remote-tracking branch 'upstream/main' into release_v0.40.0 2026-10-01 16:51:30 -07:00
routes_debug_test.go create: add server-side MLX imports and drop GGUF conversion (#14969) 2026-09-14 20:32:36 -07:00
routes_delete_test.go llama-server: prepare to remove compatibility patch 2026-09-24 19:25:52 -07:00
routes_generate_renderer_test.go create: add server-side MLX imports and drop GGUF conversion (#14969) 2026-09-14 20:32:36 -07:00
routes_generate_test.go llama-server: prepare to remove compatibility patch 2026-09-24 19:25:52 -07:00
routes_harmony_streaming_test.go create: add server-side MLX imports and drop GGUF conversion (#14969) 2026-09-14 20:32:36 -07:00
routes_list_test.go llama-server: prepare to remove compatibility patch 2026-09-24 19:25:52 -07:00
routes_options_test.go Honor model generation defaults (#16471) 2026-09-01 14:52:07 -07:00
routes_parse_error_test.go create: add server-side MLX imports and drop GGUF conversion (#14969) 2026-09-14 20:32:36 -07:00
routes_request_log_test.go add ability to turn on debug request logging (#14106) 2026-03-19 17:08:17 -07:00
routes_test.go Reduce model lookup and MLX decision request overhead (#18806) 2026-10-05 17:34:41 -07:00
routes_web_experimental_test.go openai: support web search in Responses API (#17686) 2026-08-12 11:51:54 -07:00
sched.go llama-server: prepare to remove compatibility patch 2026-09-24 19:25:52 -07:00
sched_test.go llama-server: prepare to remove compatibility patch 2026-09-24 19:25:52 -07:00
show_manifest.go llama-server: prepare to remove compatibility patch 2026-09-24 19:25:52 -07:00
show_safetensors.go mlx: System one support (#18701) 2026-10-03 13:17:21 -07:00
show_safetensors_test.go mlx: System one support (#18701) 2026-10-03 13:17:21 -07:00
sparse_common.go
sparse_windows.go
systemone_test.go mlx: System one support (#18701) 2026-10-03 13:17:21 -07:00
test_home_test.go app: harden update flows (#16100) 2026-05-11 12:24:01 -07:00
upload.go Clean up the manifest and modelpath (#13807) 2026-01-21 11:46:17 -08:00