Commit afd11cd
MUSA-0203: gate CUDAGraphWrapper(FULL) wrap behind VLLM_MUSA_DRAFT_FULL_WRAP
Step 4's load_model CUDAGraphWrapper(FULL) wrap is functionally correct
but causes accept-rate regression (47.95% -> 19.5% on M2.5+Eagle3
yeahdongcn70). Suspected cause: captured draft FA kernel reads stale
seq_lens/slot_mapping from dummy_run's synthetic batch.
Default the wrap to OFF (matches Step 1+2+3 boot behavior with FULL captures
of TARGET only, draft remains eager). Opt back in with
`VLLM_MUSA_DRAFT_FULL_WRAP=1` once the stale-state issue is debugged.
The dummy_run/dispatcher/gpu_input_batch/utils patches remain active —
they're additive and harmless without the wrap.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>1 parent 3d43c68 commit afd11cd
1 file changed
Lines changed: 7 additions & 1 deletion
Lines changed: 7 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
92 | 92 | | |
93 | 93 | | |
94 | 94 | | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
| 98 | + | |
| 99 | + | |
95 | 100 | | |
96 | 101 | | |
97 | | - | |
| 102 | + | |
| 103 | + | |
98 | 104 | | |
99 | 105 | | |
100 | 106 | | |
| |||
0 commit comments