ci: gate compiler assertions and surface direct-call Z80 findings - #67
Merged
Merged
Conversation
Add paired assertion checks, judge self-tests, advisory output and lint reports, and nightly compiler audits with reproducible local wrappers. Report MIR2/oracle fuzz findings while gating Z80/MIR2 mismatches and assembly failures on PRs; preserve strict standalone and nightly reporting. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01Wrwo36SzxKRZYTgpDo7hzo
Gate compiler errors and low fuzz pass rates, cover assertion execution paths in controls, and retain direct-call findings as report-only pending fixes. Remove baseline caching, bound summaries, and let nightly gates fail visibly. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01Wrwo36SzxKRZYTgpDo7hzo
PR tests: 🟢 passCommit:
The external CZECH and full Zork I stories are not part of this PR gate. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem and behavior
PRs currently have no cross-language assertion matrix or differential Z80 fuzz job. This adds a reusable compiler-check workflow: a merge-tree comparison of the candidate and its base, judge self-tests, a compile sweep, and a blocking folded-mode fuzz check. A nightly run uses the longer corpus and stricter findings policy. Direct-call fuzz findings are reported with reproducers but remain non-blocking while production Z80 is being repaired.
Validation
scripts/test_judges.py: 28 tests pass (2 skipped).scripts/test_ci.py: 2 tests pass, including mutation sensitivity and crash classification.04e0ba17: folded fuzz 2980/3000 pass (20 MIR2/oracle findings); direct-call 89/3000 pass, with 207 Z80/MIR2 wrong values, 2494 assembly failures, 196 compiler/execution errors, 14 MIR2/oracle findings.The direct-call numbers are a baseline for triage, not a release quality claim. GitHub CI on this PR is the final workflow check.