Repository navigation

refactor: unify cache lifecycle and isolate KV storage resources - #1655

Open

sufubao wants to merge 16 commits into

mainfrom

feat/cache-coordinator

Open

refactor: unify cache lifecycle and isolate KV storage resources#1655
sufubao wants to merge 16 commits into
mainfrom
feat/cache-coordinator

Commits on Oct 22, 2026
- refactor: unify cache lifecycle and isolate KV storage resources
  sufubao
  committed
  c38d8c4
Commits on Oct 23, 2026
- refactor: generalize cache state lifecycle and DP reuse
  sufubao
  committed
  67bcc97
- fix: exclude linear layers from packed KV mapping
  sufubao
  committed
  2c0991a
Commits on Oct 24, 2026
- fix: validate hybrid cache recovery state
  sufubao
  committed
  2138acc
- fix: bound disk cache offload queue under concurrent reuse
  sufubao
  committed
  502bbc7
- fix: bind PD control listener before publishing its port
  sufubao
  committed
  aeeac7a
- fix: reject PD requests until both node roles are available
  sufubao
  committed
  ba663f4
- test: align cache fixtures and pinned formatting checks
  sufubao
  committed
  71cacb6
- fix: allocate DeepSeek indexer gather buffer with a shape tuple
  sufubao
  committed
  684a873
- fix: pad sparse MLA query heads for tensor parallel prefill
  sufubao
  committed
  f221eb5
Commits on Oct 25, 2026
- fix: stabilize GLM reductions and sparse index selection
  sufubao
  committed
  d0145d1
- refactor: drop unrelated inference and runtime fixes
  sufubao
  committed
  87682e3
- refactor: rename cache coordinator to request cache manager
  sufubao
  committed
  2318f3a
- refactor: separate request slots from cache lifecycle
  sufubao
  committed
  891ac27
- refactor: compose cache ownership under request manager
  sufubao
  committed
  937fbdb
- refactor: keep MTP cursor with linear attention state
  sufubao
  committed
  1f9f816

Commits

Commits on Oct 22, 2026

Commits on Oct 23, 2026

Commits on Oct 24, 2026

Commits on Oct 25, 2026