mirror of
https://github.com/ollama/ollama.git
synced 2026-11-22 00:01:45 +00:00
When OLLAMA_NUM_PARALLEL is unset, select 1, 2, 4 or 8 slots using available memory and estimated per-client storage at the model's context limit. Preserve explicit settings and retain the serial default under memory pressure, for unknown cache layouts and on other backends. |
||
|---|---|---|
| .. | ||
| config.go | ||
| config_test.go | ||
| parallel_test.go | ||
| test_home_test.go | ||