Conversation
Depot CI mimics GitHub Actions: it sets `GITHUB_ACTIONS=true` and the usual `GITHUB_*` variables, so its runs were detected as GitHub Actions ones. Its run ids do not exist on GitHub Actions, so CodSpeed could not process them. Fail before running the benchmarks when `DEPOT_JOB_URL` is set, which Depot only sets on Depot CI and not on its GitHub Actions runners, with a message pointing to support to request Depot CI support. Closes COD-3635
Merging this PR will degrade performance by 13.99%
|
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| ❌ | WallTime | memtrack track tar |
8 s | 9.3 s | -13.99% |
Tip
Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.
Comparing fix/reject-depot-ci (66db707) with main (7c135cc)
Footnotes
-
4 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩
Fail with an explicit error when the runner runs on Depot CI.
Depot CI is a drop-in replacement for GitHub Actions: it sets
GITHUB_ACTIONS=trueand the usualGITHUB_*variables, so the runner detected its jobs as GitHub Actions ones. Its run ids (e.g.271476942194171) do not exist on GitHub Actions, so CodSpeed could not process these runs, and users got no feedback on why.The GitHub Actions provider now bails before any benchmark runs when
DEPOT_JOB_URLis set, pointing to support@codspeed.io and Discord to request Depot CI support.DEPOT_JOB_URLis only set on Depot CI, not on Depot's GitHub Actions runners (Depot environment variables), so those keep working.Closes COD-3635