Skip to content

Qwen3.5-397B RL trainer on 128 v7x: fp8 fake-quant hoist, fused SwiGLU backward, attention backward savings, the wi forward GMM's weight pipeline depth and the GDN context-parallel m scan as config keys - #5799

Draft
parambole wants to merge 14 commits into
atwigg/mlperffrom
parambole/rl-4600-final-maxtext
Draft

Qwen3.5-397B RL trainer on 128 v7x: fp8 fake-quant hoist, fused SwiGLU backward, attention backward savings, the wi forward GMM's weight pipeline depth and the GDN context-parallel m scan as config keys#5799
parambole wants to merge 14 commits into
atwigg/mlperffrom
parambole/rl-4600-final-maxtext

Commits

  1. Commits on Oct 16, 2026

  2. Commits on Oct 17, 2026