mirror of
https://github.com/ollama/ollama.git
synced 2026-09-21 22:04:25 +00:00
Add what a DFlash draft borrows from its target: the tapped layer
outputs, the raw embedding lookup, and the undecorated lm_head
projection. The laguna draft architecture (DFlashLagunaForCausalLM) is
registered here, alongside the only wired target.
Matched nvfp4 target+draft pairs, M5 Max, temp 0.8, repeat_penalty 1.1,
adaptive depth; decode tok/s:
prose code edit
laguna-xs plain 139.4 139.7 137.3
DFlash 142.3 139.2 145.1
laguna-s plain 75.4 70.0 72.4
DFlash 74.6 80.8 115.3
|
||
|---|---|---|
| .. | ||
| cohere2_moe | ||
| dflash | ||
| gemma3 | ||
| gemma4 | ||
| glm4_moe_lite | ||
| laguna | ||
| llama | ||
| nn | ||
| qwen3 | ||
| qwen3_5 | ||
| qwen3_5_moe | ||