You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: multimodal/qwen3-vl/README.md
+45-3Lines changed: 45 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -46,26 +46,68 @@ pip install .
46
46
47
47
### Configure the benchmark
48
48
49
-
Example configs live under [endpoints/examples/08_Qwen3-VL-235B-A22B_Example](https://github.com/mlcommons/endpoints/tree/381d13bbd27d6d52306813a51dc4e44295222d7e/examples/08_Qwen3-VL-235B-A22B_Example). Set the endpoint URL in the YAML file to match your server address and port:
49
+
Example configs live under [endpoints/examples/08_Qwen3-VL-235B-A22B_Example](https://github.com/mlcommons/endpoints/tree/381d13bbd27d6d52306813a51dc4e44295222d7e/examples/08_Qwen3-VL-235B-A22B_Example).
50
+
51
+
#### Fields that the submitter **should** update to match their server status:
52
+
53
+
- Served model name:
54
+
55
+
```yaml
56
+
model_params:
57
+
name: "Qwen/Qwen3-VL-235B-A22B-Instruct"
58
+
```
59
+
60
+
- Endpoints url and port:
50
61
51
62
```yaml
52
63
endpoint_config:
53
64
endpoints:
54
65
- "http://localhost:8000"
55
66
```
56
67
68
+
#### Fields that the submitter **may** customize for performance tuning:
69
+
70
+
- Target_qps (for server and interactive mode):
71
+
72
+
```yaml
73
+
load_pattern:
74
+
type: "poisson"
75
+
target_qps: 6.5
76
+
```
77
+
78
+
- Client worker related settings:
79
+
80
+
```yaml
81
+
client:
82
+
num_workers: 5
83
+
transport:
84
+
type: zmq
85
+
recv_buffer_size: 16777216
86
+
send_buffer_size: 16777216
87
+
max_connections: 1000
88
+
worker_initialization_timeout: 120
89
+
```
90
+
91
+
#### Fileds that the submitter **MUST NOT** change for valid results:
92
+
93
+
- Sampling parameters that specified in scection [Reference Implementation Specification](#reference-implementation-specification)
94
+
95
+
- Datasets (Neither performance or accuracy dataset)
0 commit comments