Skip to content

[PyTorch] DeepSeekV3Layer: full MoE transformer layer (MLA + DeepSeek MoE) - #3471

Open
pggPL wants to merge 58 commits into
NVIDIA:mainfrom
pggPL:deepseek_v3_layer
Open

pggPL wants to merge 58 commits into
NVIDIA:mainfrom
pggPL:deepseek_v3_layer

Compose DeepSeek expert parallel path with MoE ops

0343fab
Select commit
Loading
Failed to load commit list.