Repository navigation

fix: fix param grad sync under SP - #224

Merged

kilinchange merged 4 commits into

fix/sp-gradient-finalize

Oct 9, 2026

Commits on Oct 9, 2026
- fix: fix param grad sync under SP
  Chamberlain0w0
  committed
  da96175
- fix: seperate finalize logics from optimzer, add local grad map
  Chamberlain0w0
  committed
  6864ff3
- fix: fix qwen3-8b grad sgrad sync behavior under under TP
  Chamberlain0w0
  committed
  7d28b72
- fix: add FinalizeQKNormWeightGradients function
  Chamberlain0w0
  committed
  c15c2d1