Commit e82b62a
authored
Upgrade 0.6 torch dependencies (#837)
## Summary
Upgrade torch and torchcodec dependencies for RHAI 3.5 compatibility
## Details
We want to release a GuideLLM container image for RHAI 3.5, supporting full multimodal testing. However, RHAI 3.5 provides torch 2.11.0 and torchcodec 0.11.0, while GuideLLM 0.6.0 requires torch 2.10 and torchcodec 0.11.
This upgrades the dependencies.
## Test Plan
Manually run the audio, image, and video workloads against Qwen/Qwen3-0.6B model (which I had running) as well as Qwen/Qwen3-VL-2B-Instruct (referenced by documentation).
- [x] uv run guidellm benchmark --target http://*.example.com --request-type audio_transcriptions --profile synchronous --max-requests 20 --data openslr/librispeech_asr --data-args "{\"name\": \"clean\", \"split\": \"test\"}" --data-column-mapper "{\"audio_column\": \"audio\"}"
- [x] uv run guidellm benchmark --target http://*.example.com --request-type chat_completions --profile synchronous --max-requests 20 --data "lmms-lab/MMBench_EN" --data-args "{\"split\": \"test\"}" --data-column-mapper '{"image_column": "image", "text_column": "question"}'
- [x] uv run guidellm benchmark --target http://*.example.com --request-type chat_completions --profile synchronous --max-requests 50 --data "lmms-lab/Video-MME" --data-args "{\"split\": \"test\"}" --data-column-mapper '{"video_column": "url"}'
In this case the results (and ultimate success) are interesting but not really the point: it does not appear that the torch/torchcodec package upgrade caused problems in GuideLLM orchestration.
## Related Issues
https://redhat.atlassian.net/browse/AIPCC-16597
---
- [x] "I certify that all code in this PR is my own, except as noted below."
## Use of AI
- [ ] Includes code generated or substantially modified by an AI agent
- [ ] Includes tests generated or substantially modified by an AI agent
> NOTE: the `Generated-by` or `Assisted-by` trailers should be used in git commit messages when code or tests were generated or substantially modified by an AI agent, as described in the project's [`DEVELOPING.md`](https://github.com/vllm-project/guidellm/blob/main/DEVELOPING.md) file.
---
# git log
commit 292f458
Author: David Butenhof <dbutenho@redhat.com>
Date: Tue Jun 23 09:14:27 2026 -0400
Upgrade 0.6.0 torch dependencies
We want to release a GuideLLM container image for RHAI 3.5, supporting full
multimodal testing. However, RHAI 3.5 builds torch 2.11.0 and torchcodec
0.11.0, while GuideLLM 0.6.0 requires torch 2.10 and torchcodec 0.11.
This upgrade the dependencies.
Signed-off-by: David Butenhof <dbutenho@redhat.com>
---------
Signed-off-by: David Butenhof <dbutenho@redhat.com>1 parent a963ae9 commit e82b62a
3 files changed
Lines changed: 77 additions & 90 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
84 | 84 | | |
85 | 85 | | |
86 | 86 | | |
87 | | - | |
88 | | - | |
| 87 | + | |
| 88 | + | |
89 | 89 | | |
90 | 90 | | |
91 | 91 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
6 | 6 | | |
7 | 7 | | |
8 | 8 | | |
9 | | - | |
| 9 | + | |
10 | 10 | | |
11 | 11 | | |
12 | 12 | | |
| |||
0 commit comments