Skip to content

Eval: pf-design-token-check #136

Description

@patternfly-jira-sync

Write an eval.yaml for pf-design-token-check using agent-eval-harness.

Read the skill's SKILL.md. Identify what the skill uniquely teaches that the base model doesn't know without it. Write 2-3 test cases targeting those differentiators.

Each test case needs:

  • A prompt (realistic user request)

  • Fixture file(s) the prompt references

  • Automated checks verifying expected output

Acceptance Criteria:

  • eval.yaml exists at eval/pf-design-token-check/eval.yaml

  • Contains 2-3 discriminating test cases

  • All test cases pass locally via /eval-run


Jira Issue: PF-4378

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions