Skip to content

Add model stats view to stats page#701

Open
donjguido wants to merge 2 commits into
mainfrom
worktree-add-model-stats
Open

Add model stats view to stats page#701
donjguido wants to merge 2 commits into
mainfrom
worktree-add-model-stats

Conversation

@donjguido

Copy link
Copy Markdown
Collaborator

Summary

  • Export term_scores in build_api.py so models.json includes full per-term score arrays
  • Add toggleable "Model Stats" view to the stats page with:
    • Model selector dropdown and summary cards (total ratings, terms rated, mean score, self-congruence, rater bias)
    • Two donut pie charts: all ratings distribution vs latest score distribution
    • Stacked horizontal bar chart showing per-term score breakdown with min-evaluations filter
    • NxN pairwise congruence matrix with checkbox model selection and color-coded cells (green=similar, red=dissimilar)
  • Existing Consensus Analysis view is unchanged and remains the default

Test plan

  • Default view loads unchanged (Consensus Analysis)
  • Click "Model Stats" toggle — model selector, cards, pies, bar chart, and matrix render
  • Switch between models — all sections update
  • Adjust min evaluations slider — bar chart filters correctly
  • Toggle model checkboxes in congruence matrix — matrix re-renders with selected subset
  • Click term names in bar chart — modal opens
  • Toggle dark/light theme — all new elements respect theme
  • Test on narrow viewport — pie charts and cards stack vertically
  • Toggle back to "Consensus Analysis" — original view restored

🤖 Generated with Claude Code

donjguido and others added 2 commits March 10, 2026 23:52
…, and congruence matrix

Export term_scores in build_api.py and add a toggleable Model Stats view to the
stats page with: model selector, summary cards, donut pie charts (all ratings vs
latest), min-evaluations filtered stacked bar chart, and an NxN pairwise
congruence matrix with selectable models and color-coded cells.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Add model stats feature to CHANGELOG, add models.json and bayes-scores.json
endpoints to README API table, update for-machines index.json and index.html
to document term_scores in models.json.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant