Skip to content

VRT baseline auto-regen doesn't re-trigger CI (GITHUB_TOKEN push), forcing manual dance #311

Description

@openclaw-dv

The vrt-baseline-update label flow (in .github/workflows/ci.yml) regenerates VRT baselines and commits them back to the PR branch via github-actions[bot] using the default GITHUB_TOKEN. By GitHub design, pushes made with GITHUB_TOKEN do not trigger new workflow runs — so the required visual/test checks never run on the new baseline commit, leaving the PR HEAD with no checks and blocking merge.

Observed 3× this session (#303, #310, and #305 which the maintainer handled manually). Each time the workaround is: remove the label, then push an empty commit under a user token to get a clean run against the committed baseline.

Fix options:

  1. Push the baseline commit with a PAT or GitHub App token (e.g. the existing release-bot App) instead of GITHUB_TOKEN, so the push re-triggers CI.
  2. Restructure so the same run that commits baselines re-reports the required checks (e.g. the visual job re-runs against the just-written baselines within the same run, and the required-check contexts are satisfied on the merge commit — the run already does step 15 'Run visual regression tests' after committing, so the gap is purely that HEAD moved).
  3. Add labeled to the workflow's pull_request types so applying the label triggers a run (partial — still hits the bot-push-no-retrigger issue on the commit).

Low severity, pure CI ergonomics — but it makes every leaderboard/site-rendering PR need hand-holding.

Metadata

Metadata

Assignees

No one assigned

    Labels

    pmf-researchSurfaced from synthpanel-driven PMF research 2026-05-14

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions