Commit graph

2 commits

Author SHA1 Message Date
Daniel Hiltgen
4b2d529966
Reduce startup model hydration (#16215)
* Reduce startup model hydration

Add a lightweight model list cache for tags and launch inventory, while keeping show cache population lazy. This avoids loading every local model at startup on large model stores.

* harden flaky scheduler unit test

* remove extra launch model metadata text

* review comments

* review comments
2026-05-19 15:53:08 -07:00
Parth Sareen
d319227df0
server: cache show responses (#15967) 2026-05-05 14:40:18 -07:00