Skip to content

Commit 0973d88

Browse files
Add troubleshooting guide (#860)
## Summary Adds a troubleshooting section to the docs ## Details Talks about - Debug logging - A tokenizer situation that we've had several people ask us about. - Mac OS process failures ## Test Plan - Just read over it and make sure CI passes. --- - [x] "I certify that all code in this PR is my own, except as noted below." ## Use of AI - [ ] Includes code generated or substantially modified by an AI agent - [x] Includes markdown generated or substantially modified by an AI agent - [ ] Includes tests generated or substantially modified by an AI agent > NOTE: the `Generated-by` or `Assisted-by` trailers should be used in git commit messages when code or tests were generated or substantially modified by an AI agent, as described in the project's [`DEVELOPING.md`](https://github.com/vllm-project/guidellm/blob/main/DEVELOPING.md) file. --- # git log commit 57b86e6 Author: Jared O'Connell <joconnel@redhat.com> Date: Thu Jun 25 14:24:05 2026 -0400 Added troubleshooting guide Generated-by: Cursor AI Claude Opus 4.6 Signed-off-by: Jared O'Connell <joconnel@redhat.com> commit 5f61d4d Author: Jared O'Connell <joconnel@redhat.com> Date: Thu Jun 25 18:20:15 2026 -0400 Address review feedback Signed-off-by: Jared O'Connell <joconnel@redhat.com> commit cd49cf4 Author: Jared O'Connell <joconnel@redhat.com> Date: Thu Jun 25 18:23:02 2026 -0400 Fix docs formatting Signed-off-by: Jared O'Connell <joconnel@redhat.com> --------- Generated-by: Cursor AI Claude Opus 4.6 Signed-off-by: Jared O'Connell <joconnel@redhat.com>
1 parent 3ceb9a5 commit 0973d88

5 files changed

Lines changed: 88 additions & 1 deletion

File tree

docs/getting-started/benchmark.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -298,3 +298,7 @@ Learn more about output options in the [Outputs documentation](../guides/outputs
298298
## Authentication
299299

300300
When benchmarking against servers that require authentication (such as OpenAI's API), provide an API key in the backend configuration. See the [API Key Configuration](../guides/backends.md#api-key-configuration) section in the Backends documentation for details.
301+
302+
## Troubleshooting
303+
304+
See the [Troubleshooting guide](../guides/troubleshooting.md) for common issues.

docs/getting-started/install.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -90,4 +90,4 @@ To use the vLLM Python backend (in-process inference), see [vLLM Python backend]
9090

9191
## Troubleshooting
9292

93-
If you encounter any issues during installation, ensure that your Python and pip versions meet the prerequisites. For further assistance, please refer to the [GitHub Issues](https://github.com/vllm-project/guidellm/issues) page or consult the [Documentation](https://github.com/vllm-project/guidellm/tree/main/docs).
93+
If you encounter any issues during installation, ensure that your Python and pip versions meet the prerequisites. For common runtime errors (debug logging, tokenizer loading, macOS worker crashes), see the [Troubleshooting guide](../guides/troubleshooting.md). For further assistance, please refer to the [GitHub Issues](https://github.com/vllm-project/guidellm/issues) page.

docs/guides/datasets.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -38,6 +38,8 @@ You can specify the tokenizer with `--tokenizer` and a configuration string. The
3838

3939
- `--tokenizer '{"kind":"huggingface_auto","model":"path/to/processor","load_kwargs":{"use_fast":false}}'`
4040

41+
If a HuggingFace model requires custom code to load, pass `trust_remote_code` in `load_kwargs`. See [Troubleshooting: trust_remote_code](troubleshooting.md#trust_remote_code-required-by-tokenizer).
42+
4143
If your dataset uses non-standard column names, you can use `--data-column-mapper` to map your columns to GuideLLM's expected column names. This is particularly useful when:
4244

4345
1. Your dataset uses different column names (e.g., `question` instead of `prompt`, `instruction` instead of `text_column`)

docs/guides/index.md

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -84,4 +84,12 @@ Whether you're interested in understanding the system architecture, exploring su
8484

8585
[:octicons-arrow-right-24: Multimodal Guide](multimodal/index.md)
8686

87+
- :material-lifebuoy:{ .lg .middle } Troubleshooting
88+
89+
______________________________________________________________________
90+
91+
How to troubleshoot common errors.
92+
93+
[:octicons-arrow-right-24: Troubleshooting Guide](troubleshooting.md)
94+
8795
</div>

docs/guides/troubleshooting.md

Lines changed: 73 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,73 @@
1+
---
2+
weight: 15
3+
---
4+
5+
# Troubleshooting
6+
7+
Find your symptom below, then follow the linked fix. For CLI syntax, see [Run a Benchmark](../getting-started/benchmark.md#cli-option-format).
8+
9+
| Symptom | Section |
10+
| ----------------------------------------------------------- | ------------------------------------------------------------ |
11+
| Requests fail or results look wrong | [Debug logging](#debug-logging) |
12+
| Custom code error when loading a model's tokenizer. | [Tokenizer: trust_remote_code](#tokenizer-trust_remote_code) |
13+
| `Worker process ... died unexpectedly (signal 11)` on macOS | [macOS worker crash](#macos-worker-crash-signal-11) |
14+
15+
## Debug logging
16+
17+
Enable debig output to inspect request handling and worker startup:
18+
19+
```bash
20+
GUIDELLM__LOGGING__CONSOLE_LOG_LEVEL=DEBUG guidellm run ... --disable-progress
21+
```
22+
23+
Run `guidellm env` to confirm the settings are being applied. The `--disable-progress` call is optional, but the interactive progress console can overwrite console log messages. Alternatively, you can use a file log as mentioned in the [logging guide](../developer/developing.md#logging) .
24+
25+
For all logging options (file output, log levels), see [Logging](../developer/developing.md#logging) in the development guide.
26+
27+
## Tokenizer: trust_remote_code
28+
29+
### Symptom
30+
31+
You get an error that looks like:
32+
33+
```text
34+
The repository moonshotai/Kimi-K2.6 contains custom code which must be executed
35+
to correctly load the model. You can inspect the repository content at
36+
https://hf.co/moonshotai/Kimi-K2.6.
37+
You can avoid this prompt in future by passing the argument `trust_remote_code=True`.
38+
```
39+
40+
### Fix
41+
42+
If you fully trust the model, pass `trust_remote_code` through `--tokenizer` `load_kwargs`:
43+
44+
```bash
45+
--tokenizer '{"kind":"huggingface_auto","load_kwargs":{"trust_remote_code":true}}'
46+
```
47+
48+
Do not use this if you do not trust the model, as this allows code execution on your machine.
49+
50+
See [Datasets: Tokenizer](datasets.md#tokenizer) for other tokenizer options.
51+
52+
## macOS worker crash (signal 11)
53+
54+
### Symptom
55+
56+
```text
57+
RuntimeError: Worker process group startup failed: Worker process <pid> died
58+
unexpectedly (signal 11). Check system logs for details
59+
```
60+
61+
You may also see repeated log lines such as:
62+
63+
```text
64+
Worker process <pid> died unexpectedly (signal 11)
65+
```
66+
67+
### Fix
68+
69+
GuideLLM defaults to `fork` multiprocessing, which can segfault on macOS. Use `spawn` instead:
70+
71+
```bash
72+
GUIDELLM__MP_CONTEXT_TYPE=spawn guidellm run ...
73+
```

0 commit comments

Comments
 (0)