Skip to content

Make lowest precision, parallelism, MBS, and config_filename mandatory for v6.1 - #472

Merged
pavanky merged 2 commits into
mlcommons:masterfrom
ShriyaRishab:shriya/mandatory_precision_parallelism_v61
Aug 21, 2026
Merged

Make lowest precision, parallelism, MBS, and config_filename mandatory for v6.1#472
pavanky merged 2 commits into
mlcommons:masterfrom
ShriyaRishab:shriya/mandatory_precision_parallelism_v61

Conversation

@ShriyaRishab

@ShriyaRishab ShriyaRishab commented Aug 20, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Make lowest_numerical_precision_in_{linear,attn,comm}, {tensor,pipeline,context,expert}_parallelism, micro_batch_size, and config_filename required (EXACTLY_ONE) in training_6.1.0/common.yaml so every Closed and Open result log must report them.
  • Leave the v6.0 checker unchanged.
  • Add mllog constants and update the parallelism example so submitters can log unused dimensions as 1.

Fixes mlcommons/training#878

Companion policy PR: mlcommons/training_policies#592

Test plan

  • Confirm training_6.0.0/common.yaml still marks these keys OPTIONAL
  • Run the v6.1 compliance checker on a log missing any of the 9 keys and confirm it fails
  • Run the v6.1 compliance checker on a log that reports all 9 keys with valid values, unused parallelism = 1, and a non-empty config_filename and confirm it passes these checks
  • Confirm an invalid precision string, parallelism < 1, or micro_batch_size < 1 fails the value CHECK

Require the linear/attn/comm precision and TP/PP/CP/EP keys in every
training 6.1 result log so the checker can enforce issue #878.

Signed-off-by: ShriyaRishab <spalsamudram@nvidia.com>
@ShriyaRishab
ShriyaRishab requested review from a team as code owners August 20, 2026 21:07
@github-actions

Copy link
Copy Markdown

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

These disclosure keys were still optional; make them EXACTLY_ONE so
every result log identifies the micro-batch size and matching config.

Signed-off-by: ShriyaRishab <spalsamudram@nvidia.com>
@ShriyaRishab ShriyaRishab changed the title Make lowest precision and parallelism mandatory for v6.1 Make lowest precision, parallelism, MBS, and config_filename mandatory for v6.1 Aug 20, 2026
@pavanky
pavanky merged commit 9c5b654 into mlcommons:master Aug 21, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Make lowest precision and parallelism mandatory for all results

3 participants