Skip to content

Port GLM-5.1 B200 TileRT fixed-sequence to srt-slurm - #3553

Draft
cquil11 wants to merge 6 commits into
feat/tilert-role-engine-portsfrom
feat/tilert-b200-fixed
Draft

cquil11 wants to merge 6 commits into
feat/tilert-role-engine-portsfrom
feat/tilert-b200-fixed

Conversation

@cquil11

@cquil11 cquil11 commented Sep 28, 2026 •

Copy link
Copy Markdown
Collaborator

Based on #3551. Ports glm5.1-fp8-b200-tilert 1k1k and 8k1k to native vLLM prefill, TileRT decode, and the TileRT router.

Preserves TP8 1P1D, images, engine settings, MTP, concurrency 1, and 16 requests. Removes tilert_utils and its launcher. The required 8k1k power measurement uses srt-slurm DCGM telemetry on both nodes. The launcher mounts prepared checkpoints from shared model storage; the setup script only installs dependencies.

Validation: full 1k1k and 8k1k config sweep passed. Both cases completed 16/16 requests with zero failures; the 8k1k power audit passed for all 16 GPUs across both nodes.

@github-actions

Copy link
Copy Markdown
Contributor

Thanks for the contribution!

  • Review: If this PR changes files owned by someone other than a repository admin or @SemiAnalysisAI/core, ask one eligible CODEOWNER to complete the latest PR_REVIEW_CHECKLIST.md before contacting a core maintainer on Slack. Follow the template exactly, including As a PR reviewer and CODEOWNER, I have reviewed this and have, so sign-off verification triggers.
  • PR verification: Sweeps only run on labeled PRs. Add full-sweep-fail-fast (strongly recommended); use full-sweep-enabled only when matrix jobs should continue after a failure.
  • After merging: PR authors must ensure all GitHub Actions jobs pass. Transient failures often pass on rerun; see how to rerun failed jobs.
中文

感谢你的贡献!

  • **审阅:**如果 PR 修改的文件归属于仓库管理员及 @SemiAnalysisAI/core 之外的 CODEOWNER,请先联系一位有资格的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md,再通过 Slack 联系核心维护者。必须严格遵循模板,并保留 As a PR reviewer and CODEOWNER, I have reviewed this and have,才能触发签核验证。
  • **PR 验证:**扫描仅在带有标签的 PR 上运行。强烈建议添加 full-sweep-fail-fast;仅当需要矩阵任务在失败后继续运行时才使用 full-sweep-enabled。
  • **合并后:**PR 作者必须确保所有 GitHub Actions 任务通过。临时性失败通常可以通过重新运行恢复;参见重新运行失败任务的说明。

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: No status

Development

Successfully merging this pull request may close these issues.

1 participant