LLM completion error: context deadline exceeded #178
Replies: 2 comments 4 replies
-
|
Thanks for reporting this! The issue is confirmed. The root cause is that certain internal sub-tasks (such as We plan to add a dedicated model request timeout parameter to address this, so users can configure the per-request timeout independently for slower models. Thanks again for pointing this out! |
Beta Was this translation helpful? Give feedback.
-
|
Hi @rockdaboot, just a quick update — this has been fixed in v1.6.1. We increased the hardcoded timeout for internal sub-tasks ( If you still run into timeout issues with slower local models, please let us know. We plan to introduce a dedicated parameter (like |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
This happens even for smaller reviews with a (slow) local model (
ocr review --commit ...).The review command has a
--timeoutvalue, help text says "concurrent task timeout in minutes (default 10)". But the context deadline seems to be ~1 minute.How can I tune this, didn't find anything in the README, nor in the --help texts.
Beta Was this translation helpful? Give feedback.
All reactions