Add mesh rules that replicate dense weights across context (cp-as-ep-dense-no-cp, cp-as-ep-dense-fsdp) - #5783

Add mesh rules that replicate dense weights across context (cp-as-ep-dense-no-cp, cp-as-ep-dense-fsdp)#5783

parambole wants to merge 1 commit into

parambole/rl-trainer-4600AI-Hypercomputer/maxtext:parambole/rl-trainer-4600from

parambole/ag-l2-dense-no-cpAI-Hypercomputer/maxtext:parambole/ag-l2-dense-no-cpCopy head branch name to clipboard