Repository navigation
Add BCApps 11274 drop shipment dataset task - #903
alexei-dobriansky wants to merge 1 commit into
Conversation
There was a problem hiding this comment.
Copilot review overview
🟢 Approval recommended
The dataset entry is complete, consistent with the source PR, and successfully passed end-to-end validation.
Review effort: Balanced
Findings: None
What changed in this PR
Adds the validated BCApps 11274 drop-shipment reversal task and advances the benchmark version to 0.14.0.
Changes:
- Adds the BCApps dataset entry and text-only reproduction scenario.
- Includes production/test patches validated by the linked successful workflow run.
- Synchronizes the package and lockfile versions.
| File | Description |
|---|---|
dataset/bcbench.jsonl |
Adds the BCApps 11274 benchmark entry. |
dataset/problemstatement/microsoft__BCApps-11274/README.md |
Documents reproduction and expected behavior. |
pyproject.toml |
Bumps the benchmark to 0.14.0. |
uv.lock |
Synchronizes the locked package version. |
💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.
Sun Haoran (haoranpb)
left a comment
There was a problem hiding this comment.
Good addition, let's update the problem statement before merging
There was a problem hiding this comment.
Align the problem statement with the original bug, you will have to manually tweak the Description field a bit so it doesn't include unreachable links for the coding agent
There was a problem hiding this comment.
Updated the problem statement to match the original bug description. I retained the core blank-bin/drop-shipment failure and its expected and actual behavior, while removing the inaccessible IcM link, speculative root-cause text, engineering notes, and version prerequisites.
There was a problem hiding this comment.
I think the Problem Statement is still more clear than the original bug, is it by design?
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Copilot-Session: d824ab77-41d6-4cfc-9445-9204d1d08988
148b53c to
70fd244
Compare
Stack
Summary
microsoft__BCApps-112740.14.0Validation