Skip to content

Add mesh rules that replicate dense weights across context (cp-as-ep-dense-no-cp, cp-as-ep-dense-fsdp) - #5783

Draft
parambole wants to merge 1 commit into
parambole/rl-trainer-4600from
parambole/ag-l2-dense-no-cp
Draft

parambole wants to merge 1 commit into
parambole/rl-trainer-4600from
parambole/ag-l2-dense-no-cp

Add cp-as-ep-dense-no-cp and cp-as-ep-dense-fsdp mesh rules

20c93dc
Select commit
Loading
Failed to load commit list.