chore: refresh benchmarks for v1.25.1#962
Conversation
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Central YAML (base), Organization UI (inherited) Review profile: CHILL Plan: Pro Plus Run ID: 📒 Files selected for processing (2)
📝 WalkthroughWalkthroughThe PR refreshes benchmark data and metadata in ChangesBenchmark refresh
Estimated code review effort🎯 1 (Trivial) | ⏱️ ~5 minutes Possibly related PRs
Poem
🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Greptile SummaryThis PR refreshes the published benchmark artifacts for v1.25.1. The main changes are:
Confidence Score: 5/5This looks safe to merge.
Important Files Changed
Reviews (1): Last reviewed commit: "chore: refresh benchmarks" | Re-trigger Greptile |
🤖 Refreshed benchmarks
benchmarks/results.jsonwas pinned to aube1.25.0; the workspace is now1.25.1. Re-ranmise run bench:bumpon the hermetic Verdaccio registry (500mbit / 50ms per the mise task) and regeneratedbenchmarks/results.jsonplus the READMEBENCH_RATIOSblock. The benchmark matrix pins aube's GVS mode vianpm_config_enable_global_virtual_store=true|false(the auto-synthesized env alias for theenableGlobalVirtualStoresetting), so GitHub Actions' inheritedCI=trueenvironment does not change whether aube runs with GVS enabled or disabled.Benchmark changes
Versions:
Public ratios: warm installs vs Bun 1.3x -> 4x; warm installs vs pnpm 3x -> 6x; repeat test vs Bun 6x -> 5x; repeat test vs pnpm 39x -> 35x.
Review the numbers before merging — if anything looks wildly off vs. the previous release, investigate before landing. Hermetic proxy jitter or an npmjs uplink hiccup can occasionally skew results.
Once merged to main, the updated bench results flow into the next
release-plz-prrun automatically.Generated by the
bench-refreshworkflow.Note
Low Risk
Documentation and benchmark artifacts only; no application or install logic changes.
Overview
Re-runs the hermetic benchmark suite (
mise run bench:bump) and pinsbenchmarks/results.jsonto aube 1.25.1 (was 1.25.0) and deno 2.9.0 (was 2.8.3), with a newupdatedtimestamp and refreshed timings/stats for warm install, cold install, andinstall && test.The README
BENCH_RATIOSparagraph is regenerated from those results, so public speed claims shift—for example warm installs are now described as ~6× vs pnpm and ~4× vs Bun (previously ~3× and ~1.3×), and repeat-test ratios move to up to 35× vs pnpm and up to 5× vs Bun. The standout data change is aube’s warm fresh install dropping 1147ms → 437ms in the published table.Reviewed by Cursor Bugbot for commit 7c23b4e. Bugbot is set up for automated code reviews on this repo. Configure here.
Summary by CodeRabbit
Documentation
Chores