Repository navigation

decider: reuse request prefixes with conservative auto selection - #113

Open

Levius-Fubuki wants to merge 26 commits into

ThinkFlowLab:mainfrom

Levius-Fubuki:codex/decider-shared-prefix

Commits on Oct 7, 2026
- feat(decider): add native CPU request and response contract
  Levius-Fubuki
  committed
  407e2ad
- fix(decider): reject contradictory chat template metadata
  Levius-Fubuki
  committed
  f59cca4
- feat(decider): verify checkpoint and serve eager native CUDA decisions
  Levius-Fubuki
  committed
  9a09e5a
- feat(decider): add bounded request-local CUDA batching
  Levius-Fubuki
  committed
  19b262e
- feat(decider): isolate CUDA Graph mode and expose replay evidence
  Levius-Fubuki
  committed
  d88179c
- qwen3_5: add prefix continuation operations
  
  twu3202
  authored and
  Levius-Fubuki
  committed
  cc93e80
- qwen3_5: add a GEMM handle with one algorithm per weight shape
  
  twu3202
  authored and
  Levius-Fubuki
  committed
  a0ece5c
- qwen3_5: run prompts that share prefixes once per prefix
  
  twu3202
  authored and
  Levius-Fubuki
  committed
  e596a24
- feat(decider): integrate request-local shared prefix execution
  Levius-Fubuki
  committed
  1126c0e
- docs(decider): restore exact validation commands and identifiers
  Levius-Fubuki
  committed
  6962971
Commits on Oct 8, 2026
Commits on Oct 9, 2026
- docs(decider): restore model recipes and retained corpus guidance
  Levius-Fubuki
  committed
  ee1e90a
- docs(cuda): describe ABI 7 deployment and continuation operations
  Levius-Fubuki
  committed
  3596c2c