Search results

Stop simple_question judge from executing after _env_triad_score override

Status: Open.

#80 In microbiomedata/nmdc-ai-eval;

· turbomam opened on Apr 23, 2026

Wire PNNL AI Incubator into llm-matrix eval suites

Status: Open.

#79 In microbiomedata/nmdc-ai-eval;

· turbomam opened on Apr 21, 2026

Document feedback loop: how component eval findings inform suggestor development

Status: Open.

#77 In microbiomedata/nmdc-ai-eval;

· turbomam opened on Apr 20, 2026

Ontology-aware scoring for env-triad using envo_scorer

Status: Open.

#76 In microbiomedata/nmdc-ai-eval;

· turbomam opened on Apr 20, 2026

CBORG key has to be stored in two places (.env + llm keystore)

Status: Open.

#71 In microbiomedata/nmdc-ai-eval;

· turbomam opened on Apr 20, 2026

Add checkpoint/resume to long eval runs

Status: Open.

#68 In microbiomedata/nmdc-ai-eval;

· turbomam opened on Apr 20, 2026

Update eval_scorer to support expected output format

Status: Open.

#61 In microbiomedata/nmdc-ai-eval;

· hesspnnl opened on Apr 14, 2026

Add CHANGELOG.md to track eval framework changes

Status: Open.

#59 In microbiomedata/nmdc-ai-eval;

· turbomam opened on Apr 14, 2026

Add architecture overview documenting suite vs pipeline vs scorer

Status: Open.

#58 In microbiomedata/nmdc-ai-eval;

· turbomam opened on Apr 14, 2026

Add CLAUDE.md for AI-assisted development

Status: Open.

#57 In microbiomedata/nmdc-ai-eval;

· turbomam opened on Apr 14, 2026

ENV triad pipeline testing

Status: Open.

#55 In microbiomedata/nmdc-ai-eval;

· hesspnnl opened on Apr 13, 2026

add more evals for slot guidance. how would we score in the absence of curated gold standards?

Status: Open.

#45 In microbiomedata/nmdc-ai-eval;

· turbomam opened on Apr 1, 2026