Commit graph

9 commits

Author SHA1 Message Date
Bruce MacDonald
87cff95af8
launch: oh-my-pi (#16410) 2026-06-04 17:49:49 -07:00
Parth Sareen
91c8e5e1a8
launch: enriched model inventory (#16230) 2026-05-21 11:57:20 -07:00
Daniel Hiltgen
87288ced4f
New models (#15861)
* mlx: add laguna model support

* convert: support fp8 safetensors import

Decode HF F8_E4M3 safetensors with block scale companions into GGUF-supported tensor types, and record which output tensors came from FP8 source weights.

Use that source-precision metadata during create quantization: default FP8-sourced GGUFs to Q8_0, keep non-FP8 tensors at their original precision for Q8_0, and promote non-FP8 quantizable tensors to Q8_0 for Q4_K requests.

* ggml: add laguna model support

* server: preserve generate logprobs with builtin parsers

Generate requests were dropping logprob-only chunks whenever a builtin parser buffered visible content. Chat already handled this case, but generate only forwarded chunks with visible response, thinking, or tool-call output.

Keep generate chunks that carry logprobs even when the builtin parser has not flushed visible content yet, and add a regression test that exercises the behavior with a generic thinking parser.

* review comments - perf improvements

* ggml: implement nemotron 3 nano omni

* add poolside integration

* update poolside doc

* adapt to new cache setup

* fix test

* fix test

---------

Co-authored-by: Eva Ho <hoyyeva@gmail.com>
2026-04-28 11:50:12 -07:00
Parth Sareen
8e05d734b9
launch: add kimi cli integration with installer flow (#15723) 2026-04-20 15:33:32 -07:00
Eva H
698e04a14b
launch: OpenCode inline config (#15586) 2026-04-14 15:08:42 -07:00
Eva H
120424d832
Revert "launch/opencode: use inline config (#15462)" (#15568) 2026-04-13 18:40:17 -07:00
Eva H
f3cf6b75fb
launch/opencode: use inline config (#15462) 2026-04-13 13:41:31 -07:00
Parth Sareen
6214103e66
launch: auto-install pi and manage web-search lifecycle (#15118) 2026-03-28 13:06:20 -07:00
Parth Sareen
af5f7c0a9e
cmd: refactor tui and launch (#14609) 2026-03-12 18:39:06 -07:00