Skip to content

397B v7x trainer: MoE wo FSDP sharding and valid-rows-only MoE kernels - #5760

Draft
khatwanimohit wants to merge 2 commits into
mohit/trainer-perf-v7xfrom
mohit/trainer-perf-v7x-pending
Draft

397B v7x trainer: MoE wo FSDP sharding and valid-rows-only MoE kernels#5760
khatwanimohit wants to merge 2 commits into
mohit/trainer-perf-v7xfrom
mohit/trainer-perf-v7x-pending

MoE ring: unsort backward rows and the SiLU GLU visit only the packed…

6b58e2a
Select commit
Loading
Failed to load commit list.
Google CLA / cla/google succeeded Oct 15, 2026 in 8s

✅ All contributors are covered under a CLA with Google

See https://cla.developers.google.com/ for more info about Google's Contributor License Agreement (CLA).

ℹ️ Googlers: Go here to view more details and manage scans for this pull request.

Details

The following contributors were found for this pull request:

✅ 6b58e2a Author: @khatwanimohit <moh*******ani​@google.com>

(Only the first commit for a unique contributor is listed.)

View more details on Google CLA