intent: eval-seeding-deterministic - #444
Conversation
Tracks #439. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Deploying ystack with
|
| Latest commit: |
533fa76
|
| Status: | ✅ Deploy successful! |
| Preview URL: | https://d64a91c7.fabrica-6yx.pages.dev |
| Branch Preview URL: | https://ystack-intent-eval-seeding-d.fabrica-6yx.pages.dev |
Codex reviewer (cross-vendor, read-only)Reviewed-head: 1cff538 Posted verbatim by The change adds only an intent document. Its proposed outcomes and safety constraints match the accepted step-8 requirements and existing eval catalog; no actionable defects were found. The diff whitespace check passed. |
Codex reviewer (cross-vendor, read-only)Reviewed-head: 1a127df Posted verbatim by The intent-only change matches the accepted step-8 eval requirements and preserves the grading, authorization, and dependency boundaries. No actionable defects were found; executable code is unchanged and the diff passes whitespace checks. |
Codex reviewer (cross-vendor, read-only)Reviewed-head: 533fa76 Posted verbatim by The intent-only change matches the accepted step-8 eval requirements and preserves the existing safety boundaries. No actionable defects were found; executable behavior is unchanged, and git diff --check passed. |
Tracks #439
Adds the G1 intent for the deterministic part of step-8 child concern 10, eval seeding. Two catalog families are still
declaredwith no seeds:malicious-instructionsandreviewer-severity-false-positive-negative. The intent asks to seed both from real work without any model: malicious-instructions with a deterministic grader over at least 3 trials, one planted surface each, using R6.2's invariant-then-recompute rule (never a diff against the control); reviewer severity as a human-graded set of at least 5 trials from real recorded review verdicts, operator-labelled, passing only with zero missed Important findings. Risk high. Grader kinds and trial policies stay as the catalog lists them; model graders and any grader, trial-policy or threshold change are reserved; the operator labels the ground truth. Nothing enables before step 7 (#426) closes. Landing follows child concerns 5 and 9 per R8.Intake acceptance (from the #439 acceptance record, RC-1; re-verified via the API before opening):
b9dfe60431f4d978c3ea5155147ca89e38cc782e8dcc9755da4f6ee793a305f8ce96d36603f40dd58f5520e65d71db37909e623d4f8d14ccca1e060bf5d5c64creview_size:standard
🤖 Generated with Claude Code