mirror of
https://github.com/ollama/ollama.git
synced 2026-11-04 18:31:33 +00:00
With the new version of GGML in #12245, KV cache quantization no longer causes a fallback to CPU. |
||
|---|---|---|
| .. | ||
| ggml | ||
| gguf | ||
| util/bufioutil | ||
| config.go | ||