Skip to content

tests: drop the xfail marker and its runtests support - #4544

Merged
BsAtHome merged 1 commit into
LinuxCNC:masterfrom
grandixximo:runtests-xfail
Sep 15, 2026
Merged

BsAtHome merged 1 commit into
LinuxCNC:masterfrom
grandixximo:runtests-xfail

Conversation

@grandixximo

Copy link
Copy Markdown
Contributor

Remove the xfail marker from tests/interp/m98m99/12-M99-endless-main-program and the xfail handling from runtests.

The marker meant the test could never fail the run: a failure counted as expected, a pass printed XPASS. It was added in 2022 for the shutdown race in #857, which 7ba944c fixed in 2025; the test has passed since. The stale marker is what hid the output change from #4441 until #4537 (fixed by #4540).

I ran the test 40 times under CPU stress (2x oversubscribed cores with IO churn, then pinned to one core with six busy loops): 40 of 40 pass.

With the handling gone, a failing test always fails the run. A test that wants a negative result negates it itself, as tests/overrun already does; its checkresult grep and README follow the new summary line. The failure label goes back to FAIL: (it has printed XFAIL: for every failure since the marker was added).

Fixes #4537
Fixes #857

A test marked xfail could never fail the run: a failure counted as expected and a pass printed XPASS. The only user, interp/m98m99/12-M99-endless-main-program, got the marker in 2022 for a shutdown race (LinuxCNC#857) that 7ba944c fixed in 2025. The stale marker then hid the output change from LinuxCNC#4441 (LinuxCNC#4537, fixed in LinuxCNC#4540). The test passes 40 of 40 runs under CPU stress here.

Remove the marker and the xfail handling. A test that wants a negative result negates it itself, as tests/overrun does; its checkresult and README follow the new summary line. The failure label goes back to FAIL.

Fixes LinuxCNC#4537
Fixes LinuxCNC#857
@BsAtHome
BsAtHome merged commit 27114fb into LinuxCNC:master Sep 15, 2026
17 checks passed
@grandixximo
grandixximo deleted the runtests-xfail branch October 13, 2026 11:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

2 participants