Enable FusedSDPA slicing if chunked-prefill is enabled or max_model_len > 32k #2272

czhu15 merged 1 commit into

HabanaAI:aice/v1.22.0HabanaAI/vllm-fork:aice/v1.22.0from

yangulei:slice_long_seqyangulei/vllm-fork:slice_long_seqCopy head branch name to clipboard