mirror of
https://github.com/ollama/ollama.git
synced 2026-05-13 14:27:00 +00:00
87288ced4f
* mlx: add laguna model support * convert: support fp8 safetensors import Decode HF F8_E4M3 safetensors with block scale companions into GGUF-supported tensor types, and record which output tensors came from FP8 source weights. Use that source-precision metadata during create quantization: default FP8-sourced GGUFs to Q8_0, keep non-FP8 tensors at their original precision for Q8_0, and promote non-FP8 quantizable tensors to Q8_0 for Q4_K requests. * ggml: add laguna model support * server: preserve generate logprobs with builtin parsers Generate requests were dropping logprob-only chunks whenever a builtin parser buffered visible content. Chat already handled this case, but generate only forwarded chunks with visible response, thinking, or tool-call output. Keep generate chunks that carry logprobs even when the builtin parser has not flushed visible content yet, and add a regression test that exercises the behavior with a generic thinking parser. * review comments - perf improvements * ggml: implement nemotron 3 nano omni * add poolside integration * update poolside doc * adapt to new cache setup * fix test * fix test --------- Co-authored-by: Eva Ho <hoyyeva@gmail.com> |
||
|---|---|---|
| .. | ||
| internal | ||
| auth.go | ||
| auth_test.go | ||
| cloud_proxy.go | ||
| cloud_proxy_test.go | ||
| create.go | ||
| create_test.go | ||
| download.go | ||
| fixblobs.go | ||
| fixblobs_test.go | ||
| gemma4_test.go | ||
| images.go | ||
| images_test.go | ||
| inference_request_log.go | ||
| laguna_quantization_test.go | ||
| logprob.go | ||
| model.go | ||
| model_resolver.go | ||
| model_resolver_test.go | ||
| prompt.go | ||
| prompt_test.go | ||
| quantization.go | ||
| quantization_test.go | ||
| renderer_resolution.go | ||
| routes.go | ||
| routes_cloud_test.go | ||
| routes_create_test.go | ||
| routes_debug_test.go | ||
| routes_delete_test.go | ||
| routes_generate_renderer_test.go | ||
| routes_generate_test.go | ||
| routes_harmony_streaming_test.go | ||
| routes_list_test.go | ||
| routes_options_test.go | ||
| routes_request_log_test.go | ||
| routes_test.go | ||
| routes_web_experimental_test.go | ||
| sched.go | ||
| sched_test.go | ||
| sparse_common.go | ||
| sparse_windows.go | ||
| test_home_test.go | ||
| upload.go | ||