You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Decouple HF and vLLM framework logic from core monitoring engine #33
HF and vLLM specific logic is embedded in core engine files. Capacity check, step bytes computation, and step prep sequence are duplicated between generate.py (HF) and vllm_integration.py (vLLM). Adding a new framework requires modifying core code.
Activity