Skip to content

Upgrade pi to 0.87.1 for Claude 5.5 and GPT-6 - #556

Open
dcartertwo wants to merge 3 commits into
mainfrom
dancarter/pi-0.87-models
Open

dcartertwo wants to merge 3 commits into
mainfrom
dancarter/pi-0.87-models

Conversation

@dcartertwo

@dcartertwo dcartertwo commented Sep 23, 2026

Copy link
Copy Markdown
Collaborator

Upgrade pi to 0.87.1 to add Claude Opus 5.5, Claude Fable 5.1, and GPT-6 Astra, Sol, and Luna to Workshop’s suggested models, with catalog-backed cost estimates and the provider settings needed to run them correctly. Keep GPT-6’s 1.05M context window and 128K output limit, using 272K as the preferred compaction budget. Quick requests use low effort on Claude models that require adaptive thinking.

pi 0.87 now expects agent instructions and tool descriptions in the conversation, and asks Workshop whether to continue before signaling the end of a turn. We updated the shared agent loop to supply that context and capture pending approvals in time to save them with the turn. This preserves guidance for every model and lets agents pause for approval or a new connection with their work recorded.


Devin Review

Upgrade pi to 0.87.1 and adapt the shared agent loop to its new system-message and turn-completion behavior.
@github-actions github-actions Bot added kernel Changes to the Workshop kernel workshop/shared Changes to shared Workshop APIs labels Sep 23, 2026
@ask-bonk

ask-bonk Bot commented Sep 23, 2026

Copy link
Copy Markdown

LGTM!

github run

@github-actions

Copy link
Copy Markdown

Preview: pr556-dancarter-pi-7edb9b70

https://pr556-dancarter-pi-7edb9b70-router.cloudflare-os-previews.workers.dev

Dashboard · deleted when this PR closes

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Note

Newer findings are available below. Devin Review posted a newer report on this PR, in addition to the findings presented here.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no bugs or issues to report.

Devin Review

@github-actions

github-actions Bot commented Sep 23, 2026

Copy link
Copy Markdown

Eval runs comparison

Baseline c38bd1e0 vs candidate 391f89cd · gpt-5.6-luna · 10 trials per task.

No cohort is comparable.

Not compared:

  • eval definition changed: appointment-desk 10/10 → 9/10, expense-ledger 6/10 → 6/10, project-doc 9/10 → 8/10

Run · trajectories and raw results

@ask-bonk

ask-bonk Bot commented Sep 23, 2026

Copy link
Copy Markdown

Eval runs review

Measured. No cohort is comparable because all three eval definitions changed, so no measured deltas can be attributed.

github run

@ask-bonk

ask-bonk Bot commented Sep 23, 2026

Copy link
Copy Markdown

LGTM!

github run

Comment thread packages/workshop-shared/src/api.ts Outdated
"claude-haiku-4-5": {name: "Claude Haiku 4.5", contextWindow: 200000},
},
"openai": {
// pi's GPT-6 catalog advertises a 272K window; reserve the 128K response cap when sizing

@Maximo-Guk Maximo-Guk Sep 23, 2026

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why does it use 272k window instead of full million context with compactionInputBudget of 272k like gpt 5.6-sol?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clanker said that was the limit. i didn't verify

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All GPT-6 models have a 1,050,000 context limit.

272,000 is the suggested compaction trigger -- that is exactly what compactionInputBudget is for, so we should use that.

(I do think this whole thing needs to be revised a bit but maybe not in this PR.)

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch—updated all three GPT-6 models to a 1,050,000-token context window with a 272,000-token preferred compaction budget (and the existing 128,000-token output cap) in 391f89c. Updated the model and compaction tests and corrected the PR description.

@ask-bonk

ask-bonk Bot commented Sep 23, 2026

Copy link
Copy Markdown

Eval runs review

Measured. No cohort is comparable because all three eval definitions changed, so no measured deltas can be attributed.

github run

Comment thread pnpm-workspace.yaml
@ask-bonk

ask-bonk Bot commented Sep 23, 2026

Copy link
Copy Markdown

LGTM!

github run

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Devin Review found 1 new potential issue.

Devin Review

Comment on lines +1327 to +1328
// pi's GPT-6 catalog reports a 272K window, but these models support 1.05M. Use 272K as the
// preferred compaction budget, not as the hard context limit.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔍 Conflicting GPT-6 context limits

contextWindow overrides pi’s 272K catalog value with 1.05M. The PR description still defines 272K as the hard window, so provider confirmation is needed.

Devin Review


Was this helpful? React with 👍 or 👎 to provide feedback.

@ask-bonk

ask-bonk Bot commented Sep 23, 2026

Copy link
Copy Markdown

Eval runs review

Measured. No cohort is comparable because all three eval definitions changed, so no measured deltas can be attributed.

github run

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

kernel Changes to the Workshop kernel workshop/shared Changes to shared Workshop APIs

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants