Skip to content

Add deterministic human Claim review batches - #126

Merged
basicmi merged 1 commit into
masterfrom
claim-review-batch-workflow
Nov 17, 2026
Merged

basicmi merged 1 commit into
masterfrom
claim-review-batch-workflow

Conversation

@basicmi

@basicmi basicmi commented Nov 17, 2026

Copy link
Copy Markdown
Owner

Motivation

PR #125 restores full source-grounded payloads for the 2,525-item historical Claim backlog. The remaining gap is operational: reviewers need a bounded, prioritized work packet and a decision template that matches the existing human ledger.

Changes

  • Add a deterministic Claim review batch builder with a default limit of 25 (configurable 1–100).
  • Select never-reviewed pending Claims by triage priority descending, first-seen age descending, then Claim ID.
  • Keep needs_more_evidence Claims in a separate follow-up queue so they do not repeatedly displace new work.
  • Include Claim statement, original source URL, extracted source excerpt, classifications, scope, value/unit, qualifiers, risk flags and priority factors.
  • Generate an empty JSON decision template with exactly the same schema as data/intelligence-review-decisions.json.
  • Publish JSON, Markdown and decision template as weekly discovery artifacts and in the GitHub Actions summary.
  • Add nine offline tests covering ordering, stable batch IDs, follow-up separation, partial payloads, decision schema, policy boundaries and invalid input.

Safety

  • The batch builder is read-only and does not write the human decision ledger.
  • It does not mark Claims verified or approve evidence for production registries.
  • Priority remains a work-routing signal, not truth confidence.
  • A completed human decision still requires reviewer identity, timestamp and at least 30 characters of rationale.

Expected result

Each weekly discovery run exposes one manageable first-pass batch (up to 25 Claims) and a separate follow-up queue. Once reviewers commit decisions to the existing ledger, handled Claims leave the first-pass queue and the next pending batch advances automatically.

@basicmi
basicmi merged commit 2531ab3 into master Nov 17, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant