Repository navigation

fix: supcon oom - #48

Merged

EYH0602 merged 2 commits into

mainfrom

Feb 7, 2026

Merged

fix: supcon oom#48
EYH0602 merged 2 commits into
mainfrom
fix/supcon-oom

Commits on Feb 7, 2026
- fix: avoid OOM by computing MLM loss per-half instead of on concatenated batch
  EYH0602
  committed
  b9b9b0a
- fix: OOM on single GPU by splitting LM head computation per-chunk
  EYH0602
  committed
  9bcbbc1