Skip to content

CI: retry the LSQB runner's wall-clock tests; document the flake - #14

Merged
alexy merged 1 commit into
mainfrom
ci/retry-runner-timing-tests
Sep 20, 2026
Merged

alexy merged 1 commit into
mainfrom
ci/retry-runner-timing-tests

Conversation

@alexy

@alexy alexy commented Sep 20, 2026

Copy link
Copy Markdown
Member

main's workspace run failed on a documentation-only commit (5507be0): three of the LSQB runner's process-supervision tests failed together with could not be reaped after SIGKILL and did not become READY within the configured timeout. Those tests assert wall-clock windows as short as 50 ms, and a starved hosted runner can stall a process for longer.

  • The Graph benchmark tests step makes up to three attempts and emits a warning per failed attempt. A real defect fails all three, so a red build still means something.
  • docs/LSQB_RUNNER_TIMING_FLAKES.md records the observations, the reproduction, and the fix that belongs in the harness.

Reproduction: none on macOS with all cores saturated, none on Linux limited to one CPU (0 of 27 runs). On Linux limited to 0.4 CPU: 1 of 12 runs failed in parallel and 2 of 12 with --test-threads=1, so serialising the tests is not a fix.

This is a workaround. The tests are not mine and I have not changed them; widening their windows is left to the harness's owner, with the evidence.

🤖 Generated with Claude Code

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@alexy
alexy merged commit d6ecf31 into main Sep 20, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant