Sync 4 layer norms - bf16, fp32, optimizer states on restart - #274
Open
tjruwase wants to merge 40 commits into
Open
Sync 4 layer norms - bf16, fp32, optimizer states on restart#274tjruwase wants to merge 40 commits into
tjruwase wants to merge 40 commits into