Skip to content

fix: resolve scoring test failures and pre-existing bugs#19

Merged
tcconnally merged 1 commit into
mainfrom
fix/scoring-tests-issue-18
Jun 18, 2026
Merged

fix: resolve scoring test failures and pre-existing bugs#19
tcconnally merged 1 commit into
mainfrom
fix/scoring-tests-issue-18

Conversation

@tcconnally

Copy link
Copy Markdown
Collaborator

Summary

  • Regenerate expected_order.json fixture for test_corpus_expected_ordering_from_fixture
  • Update excluded_non_scorable threshold from >= 5 to >= 4 in test_attack_chains_meta_present_but_excluded_from_v2_basis
  • Recompile sigma metadata rules bundle (fixes test_sigma_bundle_in_sync)
  • Fix AttributeError in prompt_injection.py when tool is None (prompt-only surfaces)

Fixes #18

- Regenerate expected_order.json fixture for test_corpus_expected_ordering_from_fixture
- Update excluded_non_scorable threshold from >= 5 to >= 4
- Recompile sigma metadata rules bundle
- Fix AttributeError in prompt_injection when tool is None (prompt-only surfaces)

Fixes #18
@tcconnally tcconnally merged commit a9a7b41 into main Jun 18, 2026
6 of 17 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[HIGH] 2 scoring tests failing on main — ordering assertion + excluded_non_scorable threshold

1 participant