Skip to content

Algorithm - Add top-1 load balancing loss for MoE routing#67

Open
qghuxmu wants to merge 11 commits into
devfrom
qingguo/onehot_lbl
Open

Algorithm - Add top-1 load balancing loss for MoE routing#67
qghuxmu wants to merge 11 commits into
devfrom
qingguo/onehot_lbl

update unit test, use transformer block to test layerwise moe topk

f7028c3
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar