Skip to content

[Bug] [Func] [SDV]When launching a dual-machine PD hybrid service on a GLAM5 model, an error occurred during the ais_bench performance test. #541

@yangfen0903

Description

@yangfen0903

Checklist

  • I searched related issues but found no solution.
  • The bug persists in the latest version.
  • Issues without environment info and a minimal reproducible demo are hard to resolve and may receive no feedback.
  • If this is not a bug report but a general question, please start a discussion at https://github.com/sgl-project/sglang/discussions. Otherwise, it will be closed.
  • Please use English. Otherwise, it will be closed.

Describe the bug

[Version Information] main-cann8.5.0-a3
[Version problem] New version issue
[Assignee] chenxu
[Issue Time] 2026/5/14
[Valid issue] Yes

[Description]
When starting the glm5 service and using ais_bench for performance testing, an error occurred midway through the test. The error message is:Trying to create tensor with negative dimension -737552768: [-737552768, 6144]

Reproduction

[Test Steps]
In a dual-machine hybrid deployment scenario, the glm5 model service is launched, and performance is tested using ais_bench.
[Expected Result]
All test cases passed
[Actual Result]
The error message is:Trying to create tensor with negative dimension -737552768: [-737552768, 6144]

Environment

A3 2-machine PD Mix

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions