V0.0.2 Release Plan

[yzygitzh]

Release Manager

@yzygitzh

Endgame

• Code freeze: June. 9, 2025
• Bug Bash date: June. 10, 2025
• Release date: June. 13, 2025

Framework Features

CI/CD - @yzygitzh

1. • Initiate CI/CD pipeline for unit tests (CI/CD - Initiate CI/CD pipeline for unit tests #37 and CI/CD - Remove libtcmalloc dependency in test script for AMD platform #47)

Checkpoint - @abuccts

1. • Disable non-blocking when saving dist checkpoint in AMD GPUs (Checkpoint - Disable non-blocking when saving dist checkpoint in AMD GPUs #28)

TODOs

Framework Features

Checkpoint

1. • Fix wrong offset in grouped gemm for dist checkpoint (Checkpoint - Fix wrong offset in grouped gemm for dist checkpoint #29) - @abuccts
2. • Support dist checkpoint upload (Checkpoint - Support dist checkpoint upload #38) - @abuccts
3. • Add non-VPP to VPP model checkpoint converter (Checkpoint - Add non-VPP to VPP model checkpoint converter #35) - @limou102

Parallelism - @lhzhang333

1. • Enable interleaved-pp when layers in pp stage not divisible by vpp degree (Parallelism - Enable interleaved-pp when layers in pp stage not divisible by vpp degree #27)

Logging

1. • Add per-layer grad norm logs (Parallelism - Enable interleaved-pp when layers in pp stage not divisible by vpp degree #27) - @yzygitzh
2. • Add detailed MoE metrics (Logging - Add detailed MoE metrics  #36) - @THUzxj