Feat/cross rate early exit#605

ushaket wants to merge 7 commits into

vllm-project:mainvllm-project/guidellm:mainfrom

ushaket:feat/cross-rate-early-exitushaket/guidellm:feat/cross-rate-early-exitCopy head branch name to clipboard