[Bugfix][Rollout] Record prefix_cache_hit_rate from vLLM usage#241

aoshen02 wants to merge 1 commit into

mainvllm-project/vime:mainfrom

enable-prefix-cache-hit-ratevllm-project/vime:enable-prefix-cache-hit-rateCopy head branch name to clipboard