chore(evals): add sonnet-5, gpt-5.6, and grok pricing to braintrust UI publisher#2318
Conversation
Standard (non-introductory) Sonnet 5 rates so published eval cost metrics price sonnet-5 runs instead of falling through as unknown. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
|
miguelg719
changed the title
![cubic-dev-ai[bot]](https://avatars.githubusercontent.com/in/1082092?s=60&v=4){kind=small}
There was a problem hiding this comment.
All reported issues were addressed across 1 file (changes from recent commits).
Reply with feedback, questions, or to request a fix.
Re-trigger cubic
miguelg719
changed the title
miguelg719
changed the title
There was a problem hiding this comment.
All reported issues were addressed across 1 file (changes from recent commits).
Tip: Review your code locally with the cubic CLI to iterate faster.
Re-trigger cubic
2 participants
Why
Sonnet 5, GPT-5.6, and Grok eval runs published to the Braintrust UI had no pricing entry, so their cost metrics fell through as unknown.
What changed
Added to the publisher's
MODEL_PRICING_USD_PER_1M_TOKENSmap (prefixed and unprefixed forms per the map's convention):claude-sonnet-5gpt-5.6-solgpt-5.6-terragpt-5.6-lunagrok-4.5grok-4.3GPT-5.6 keys match the CUA model ids added in #2343 (
openai/gpt-5.6-{sol,terra,luna}). Grok rates per docs.x.ai/developers/models (2026-07).Deliberate trade-off (noted in the code comment): Sonnet 5 introductory pricing ($2 / $0.20 / $10) applies through 2026-08-31, so costs published before then are overstated ~1.5x; standard rates keep the dashboard stable across the cutover instead of requiring a September flip.
Tests
Internal publish script; no behavior beyond the map entries. Typecheck green.