Repository navigation

Wzj demo - #1628

Open

hiworldwzj wants to merge 22 commits into

mainfrom

wzj_demo

Open

Wzj demo#1628
hiworldwzj wants to merge 22 commits into
mainfrom
wzj_demo

Commits on Oct 13, 2026
- perf: batch KV page allocation and fuse token and KV index gathering
  niushengxiao
  committed
  15f6e19
- perf: prioritize token index management with paged KV support
  niushengxiao
  committed
  d338372
Commits on Oct 14, 2026
- refactor: mirror request token indexes on CPU and fuse input padding
  hiworldwzj
  committed
  80ca24c
- style: revert unrelated blank-line changes
  hiworldwzj
  committed
  20e1a79
- perf: reuse request buffers and publish DP indexes on GPU
  hiworldwzj
  committed
  9c7d44a
- refactor: simplify request index allocation with deque
  hiworldwzj
  committed
  4d50e73
- perf: remove redundant PD first-token stream synchronization
  hiworldwzj
  committed
  cff1cd8
- fix: disable prefix cache for prompt logprobs requests
  hiworldwzj
  committed
  15942d9
- docs: clarify stream-ordered KV index copy lifetime
  hiworldwzj
  committed
  43303f8
Commits on Oct 22, 2026
- Refactor request token indexes and paged KV allocation
  hiworldwzj
  committed
  997404a
Commits on Oct 23, 2026
- refactor: remove redundant request index mode state
  hiworldwzj
  committed
  0af0bca
- Reserve 2K output tokens in initial pinned index buffer
  hiworldwzj
  committed
  6566f1f
- Add page-compressed pinned request token index cache
  hiworldwzj
  committed
  ae95b2d
- Fix partial token reads in page-cached request indexes
  hiworldwzj
  committed
  e77f3d1
- fix doc
  hiworldwzj
  committed
  9c0107b
- Validate request token index bounds and page appends
  hiworldwzj
  committed
  760e8aa
- Fix decode capacity checks before optional token reservation
  hiworldwzj
  committed
  d91d3cd
- Refactor inference preparation and hybrid cache release
  hiworldwzj
  committed
  f281a1a
- Refactor request cache prefix state updates
  hiworldwzj
  committed
  bae2aaf
- Refactor request KV allocation ownership and index pool naming
  hiworldwzj
  committed
  b771127
- Refactor hybrid radix cache prefix restoration
  hiworldwzj
  committed
  7c14bca
Commits on Oct 24, 2026
- Reduce persistent pinned memory for request token indexes
  hiworldwzj
  committed
  a5342fd

Commits

Commits on Oct 13, 2026

Commits on Oct 14, 2026

Commits on Oct 22, 2026

Commits on Oct 23, 2026

Commits on Oct 24, 2026