Skip to content

Make MoE dispatch/MLP expert-axis batch sharding configurable (fix Mixtral EP throughput) - #4179

Merged
copybara-service[bot] merged 1 commit into
AI-Hypercomputer:mainfrom
ROCm:fix-moe-expert-parallel-sharding
Jun 23, 2026
Merged

Make MoE dispatch/MLP expert-axis batch sharding configurable (fix Mixtral EP throughput)#4179
copybara-service[bot] merged 1 commit into
AI-Hypercomputer:mainfrom
ROCm:fix-moe-expert-parallel-sharding

Make MoE dispatch/MLP expert-axis batch sharding configurable

ea41360
Select commit
Loading
Failed to load commit list.
Google CLA / cla/google succeeded Jun 22, 2026 in 7s

✅ All contributors are covered under a CLA with Google

See https://cla.developers.google.com/ for more info about Google's Contributor License Agreement (CLA).

ℹ️ Googlers: Go here to view more details and manage scans for this pull request.

Details

The following contributors were found for this pull request:

✅ ea41360 Author: @gulsumgudukbay <gu****ay​@gmail.com>

(Only the first commit for a unique contributor is listed.)

View more details on Google CLA