Skip to content

Add CI: skill-checks workflow#9

Merged
kurenn merged 1 commit into
mainfrom
add-ci-skill-checks
Jun 9, 2026
Merged

Add CI: skill-checks workflow#9
kurenn merged 1 commit into
mainfrom
add-ci-skill-checks

Conversation

@kurenn

@kurenn kurenn commented Jun 9, 2026

Copy link
Copy Markdown
Owner

Turns the manual guards into a GitHub Action that runs on every PR — for everything checkable without a browser or a live Claude run:

  • Context-cost regression guard — fails if SKILL.md trigger-time exceeds 2600 tokens (current ~2230), protecting the −70% progressive-disclosure win from silently bloating back.
  • shellcheck on benchmark/*.sh + ensure-deps.sh (catches the class of shell bugs found during this work).
  • node --check on the scaffold JS that's copied into every prototype — a syntax error there breaks all output.
  • py_compile on serve.py.
  • SKILL.md frontmatter sanity — name/description present, description ≤ 1024 chars.

The browser-dependent guards (render.sh, check-overflow.sh, score-output.sh) need a generated prototype, so they stay local/manual by design — documented in benchmark/README.md.

Verified locally: all five checks pass on current main (shellcheck clean, 8/8 JS valid, serve.py compiles, 2229 tokens < ceiling, description 632 chars). This PR run is the live test.

🤖 Generated with Claude Code

Turns the manual guards into automated ones for everything checkable without a
browser or a live Claude run:
- context-cost regression guard (fails if SKILL.md trigger-time > 2600 tokens,
  protecting the progressive-disclosure win)
- shellcheck on benchmark/*.sh + ensure-deps.sh
- node --check on the scaffold JS copied into every prototype
- py_compile on serve.py
- SKILL.md frontmatter sanity (name/description present, description <= 1024 chars)

The browser-dependent guards (render.sh, check-overflow.sh, score-output.sh)
need a generated prototype, so they stay local/manual by design.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@kurenn kurenn merged commit a329a40 into main Jun 9, 2026
1 check passed
@kurenn kurenn deleted the add-ci-skill-checks branch June 9, 2026 19:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant