Skip to content

Add off-graph KV-cache cell reference: multi-sequence batching - #21761

Merged
kiymetakdemir merged 3 commits into
pytorch:mainfrom
kiymetakdemir:kvcache-cells
Aug 13, 2026
Merged

Add off-graph KV-cache cell reference: multi-sequence batching#21761
kiymetakdemir merged 3 commits into
pytorch:mainfrom
kiymetakdemir:kvcache-cells

Address review: test that freeing the tail shrinks the read window

490bfea
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
label
succeeded Aug 12, 2026 in 4s