All notable changes to this project are documented here. The format is based on Keep a Changelog and this project adheres to Semantic Versioning.
0.1.0 - 2025-01-01
- Stable snapshot serialization with deep key sorting and configurable
redaction (dotted paths +
*wildcard). - Structured diffing of agent runs: added / removed / changed / renamed tool calls, per-argument field diffs, input and output diffs.
exactandtolerantcomparison modes with anignorelist.agentcheck.yamlscenario configuration and parser (js-yaml).- Pluggable
Judgeinterface for LLM-as-judge with a deterministic offline fake judge. - Pluggable
AgentRunnerand a runner that produces a pass/fail report plus a PR-comment-style markdown summary. - Provider adapters:
normalizeToolCallsfor OpenAI, Anthropic, and LangGraph. - CLI:
agentcheck runandagentcheck update. - Composite GitHub Action (
action.yml) that runs in CI and comments the diff on the PR. - Bundled offline example (sample agent + scenarios + snapshots).
- 77 unit tests (vitest); strict TypeScript.