Skip to content

[PyTorch] Quantize distributed BF16 weights in the fused grouped MLP - #3695

Closed
xrennvidia wants to merge 2 commits into
NVIDIA:mainfrom
xrennvidia:xren/fused_grouped_mlp_gtp_bf16_weight_requant
Closed

xrennvidia wants to merge 2 commits into
NVIDIA:mainfrom
xrennvidia:xren/fused_grouped_mlp_gtp_bf16_weight_requant

[PyTorch] Drop NVFP4 rowwise input copies from the fused grouped MLP …

cb1ffc4
Select commit
Loading
Failed to load commit list.