Skip to content

Add BCApps 11274 drop shipment dataset task - #903

Open
alexei-dobriansky wants to merge 1 commit into
dataset/stack-04-bcapps-10808from
dataset/stack-05-bcapps-11274
Open

alexei-dobriansky wants to merge 1 commit into
dataset/stack-04-bcapps-10808from
dataset/stack-05-bcapps-11274

Conversation

@alexei-dobriansky

@alexei-dobriansky alexei-dobriansky commented Sep 25, 2026 •

Copy link
Copy Markdown
Collaborator

Stack

  1. Add BCApps 7070 subscription customer dataset task #900 — BCApps 7070
  2. Add BCApps 10345 service contract dataset task #901 — BCApps 10345
  3. Add BCApps 10808 exchange rate dataset task #902 — BCApps 10808
  4. BCApps 11274 drop-shipment reversal and version bump (this PR)

Summary

  • add microsoft__BCApps-11274
  • align the problem statement with the original bug while removing inaccessible and speculative context
  • bump the benchmark version to 0.14.0

Validation

  • artifact, dataset, version, lockfile, lint, format, and type checks pass
  • previously passed end-to-end in run 35894324791

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot review overview

🟢 Approval recommended

The dataset entry is complete, consistent with the source PR, and successfully passed end-to-end validation.

Review effort: Balanced
Findings: None

What changed in this PR

Adds the validated BCApps 11274 drop-shipment reversal task and advances the benchmark version to 0.14.0.

Changes:

  • Adds the BCApps dataset entry and text-only reproduction scenario.
  • Includes production/test patches validated by the linked successful workflow run.
  • Synchronizes the package and lockfile versions.
File Description
dataset/​bcbench.jsonl Adds the BCApps 11274 benchmark entry.
dataset/​problemstatement/​microsoft__BCApps-11274/​README.md Documents reproduction and expected behavior.
pyproject.toml Bumps the benchmark to 0.14.0.
uv.lock Synchronizes the locked package version.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

@haoranpb Sun Haoran (haoranpb) left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good addition, let's update the problem statement before merging

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Align the problem statement with the original bug, you will have to manually tweak the Description field a bit so it doesn't include unreachable links for the coding agent

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated the problem statement to match the original bug description. I retained the core blank-bin/drop-shipment failure and its expected and actual behavior, while removing the inaccessible IcM link, speculative root-cause text, engineering notes, and version prerequisites.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think the Problem Statement is still more clear than the original bug, is it by design?

@alexei-dobriansky
alexei-dobriansky removed this pull request from stack #904 September 29, 2026 20:13
@alexei-dobriansky
alexei-dobriansky added this pull request to stack #906 September 29, 2026 20:14
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

Copilot-Session: d824ab77-41d6-4cfc-9445-9204d1d08988

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants