Commit graph

1 commit

Author SHA1 Message Date
Daniel Hiltgen
b8db8d5b5c
mlxrunner: reuse saved prefixes across request slots (#19677)
Reuse completed prefix checkpoints from another slot, including one still
serving a request. Restore into recipient-owned state and copy full-attention
history directly without materializing an intermediate donor snapshot.

Cover donor lifetime, pending captures, cancellation, media and drafting
boundaries, merged history, and cached evaluation.
2026-11-16 20:54:35 -08:00