Skip to content

[Klaud Cold] Update qwen3.5-fp8-h200-sglang-agentic-hicache-mtp SGLang image to v0.5.19-cu130 / 将 qwen3.5-fp8-h200-sglang-agentic-hicache-mtp 的 SGLang 镜像更新至 v0.5.19-cu130 #2966

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
adibarra merged 3 commits into from
Sep 10, 2026
+8 −1
Merged

[Klaud Cold] Update qwen3.5-fp8-h200-sglang-agentic-hicache-mtp SGLang image to v0.5.19-cu130 / 将 qwen3.5-fp8-h200-sglang-agentic-hicache-mtp 的 SGLang 镜像更新至 v0.5.19-cu130 #2966

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
465389f
config: update qwen3.5-fp8-h200-sglang-agentic-hicache-mtp SGLang ima…
Klaud-Cold Sep 10, 2026
8604d93
changelog: record qwen3.5-fp8-h200-sglang-agentic-hicache-mtp image u…
Klaud-Cold Sep 10, 2026
cf5902f
chore: sync main for PR #2966 sweep reuse [skip-sweep]
adibarra Sep 10, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion configs/nvidia-master.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7544,7 +7544,7 @@ qwen3.8next-fp8-h200-sglang-agentic-mtp:
# H200 AgentX MTP frontier with DRAM HiCache. This is intentionally an MTP-only
# submission; the model's non-speculative AgentX arm is not included.
qwen3.5-fp8-h200-sglang-agentic-hicache-mtp:
image: lmsysorg/sglang:nightly-dev-cu13-20260907-30705c00
image: lmsysorg/sglang:v0.5.19-cu130
model: Qwen/Qwen3.5-397B-A17B-FP8
model-prefix: qwen3.5
runner: cluster:h200-dgxc
Expand Down
7 changes: 7 additions & 0 deletions perf-changelog.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7138,3 +7138,10 @@
- "Pin vLLM nightly-9ea8f3ffc354901b740f0b31988900897b7221d7, Dynamo 1.5.0.dev20260908, and NVIDIA/srt-slurm d50ee7280c33d469df8708e363e23be2456e94fb."
- "Use Dynamo-native MiniMax parsing, EAGLE3 with FlashInfer, FULL_AND_PIECEWISE CUDA graphs, and wait for the OpenAI chat route before AgentX trace replay."
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/2925

- config-keys:
- qwen3.5-fp8-h200-sglang-agentic-hicache-mtp
description:
- "Update SGLang image from lmsysorg/sglang:nightly-dev-cu13-20260907-30705c00 (2026-09-07 cu13 dev nightly, build commit sgl-project/sglang@30705c00) to the v0.5.19 release image lmsysorg/sglang:v0.5.19-cu130 (digest sha256:d6e7288627be8b02be88e4bba38e73f6d50e2826869f753c13a4c4385ab3eda9, build commit sgl-project/sglang@0bcd822377da7b5718e674eaf9c870d349424dd1, Docker Hub last pushed 2026-09-04T22:50:19Z)."
- "The release image ships the same CUDA 13.0.3, FlashInfer 0.6.18 and sgl-kernel 0.4.6.post1 as the nightly. benchmarks/single_node/agentic/qwen3.5_fp8_h200_mtp.sh is unchanged: SGLANG_ENABLE_SPEC_V2 EAGLE MTP at 3 steps, golden acceptance length 3.39, flashinfer attention with allreduce fusion, fp8 quantization and fp8_e4m3 KV, HiCache kernel IO / page_first layout. TP8/EP1 DRAM HiCache concurrency 2 through 24 unchanged."
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/2966