Skip to content

chore(deps): update computesdk provider packages to latest npm releases - #482

Merged
kisernl merged 1 commit into
masterfrom
devin/1790701296-update-provider-packages
Sep 29, 2026
Merged

kisernl merged 1 commit into
masterfrom
devin/1790701296-update-provider-packages

Conversation

@kisernl

@kisernl kisernl commented Sep 29, 2026

Copy link
Copy Markdown
Collaborator

Summary

Bumps all benchmark provider dependencies to their latest npm releases:

  • All 45 @computesdk/* provider packages updated to latest (e.g. @computesdk/vercel 1.7.37 → 1.7.39, @computesdk/modal 1.9.11 → 1.9.13, @computesdk/runloop 1.3.60 → 1.3.61)
  • computesdk 4.1.7 → 4.1.8
  • Direct provider SDKs used by benchmark scripts: tensorlake 0.5.135 → 0.5.136, @superserve/sdk 0.8.3 → 0.9.1

One call-site change required by the upgrade: @computesdk/modal 1.9.13 removed the scalableSandboxes config option — the provider now always uses client.sandboxes.create (the experimentalCreate path was dropped upstream). The flag was removed from the modal entries in benchmarks/sandbox/providers.ts and benchmarks/scale/providers.ts; Modal benchmarks will now run against the standard sandbox endpoint.

pnpm typecheck passes.

Link to Devin session: https://app.devin.ai/sessions/836f520338ec400e9c7cc2a6566a532e
Open in Devin Desktop: https://app.devin.ai/desktop/session/836f520338ec400e9c7cc2a6566a532e?variant=devin
Requested by: @kisernl

Co-Authored-By: Noah Kiser <noah@computesdk.com>
@devin-ai-integration

Copy link
Copy Markdown
Contributor

I'll fix CI failures and address comments from users with write access. I'll skip comments containing "(aside)".

  • Disable automatic comment, CI, and merge conflict monitoring

@kisernl
kisernl marked this pull request as ready for review September 29, 2026 17:04
@open-cla

open-cla Bot commented Sep 29, 2026

Copy link
Copy Markdown

Contributor License Agreement

All contributors are covered by a CLA.

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no bugs or issues to report.

Devin Review

@kisernl
kisernl merged commit 03e1d58 into master Sep 29, 2026
7 checks passed
@github-actions

github-actions Bot commented Sep 29, 2026 •

Copy link
Copy Markdown
Contributor

Sandbox Benchmark Results

Burst

# Provider Score Median TTI P95 P99 Status
1 isorun 99.7 0.03s 0.04s 0.04s 10/10
2 createos 99.2 0.08s 0.09s 0.09s 10/10
3 archil 98.5 0.14s 0.16s 0.16s 10/10
4 miosa 98.5 0.15s 0.17s 0.17s 10/10
5 arker 98.5 0.15s 0.16s 0.16s 10/10
6 declaw 98.4 0.16s 0.17s 0.17s 10/10
7 givemeanode 98.3 0.16s 0.18s 0.18s 10/10
8 superserve 97.6 0.24s 0.25s 0.25s 10/10
9 daytona 97.0 0.22s 0.40s 0.40s 10/10
10 beam 97.0 0.28s 0.33s 0.33s 10/10
11 blaxel 96.7 0.31s 0.35s 0.35s 10/10
12 tenki 94.0 0.58s 0.62s 0.62s 10/10
13 vercel 93.5 0.41s 1.03s 1.03s 10/10
14 cloud-run 92.6 0.62s 0.93s 0.93s 10/10
15 cloudflare 92.2 0.65s 0.97s 0.97s 10/10
16 runloop 87.0 1.03s 1.71s 1.71s 10/10
17 upstash 86.8 1.30s 1.35s 1.35s 10/10
18 mosaic 86.3 0.97s 1.96s 1.96s 10/10
19 e2b 85.8 1.26s 1.65s 1.65s 10/10
20 sandbox0 84.5 1.24s 1.99s 1.99s 10/10
21 sail 83.0 1.52s 1.97s 1.97s 10/10
22 microsandbox 79.5 1.98s 2.15s 2.15s 10/10
23 freestyle 76.6 0.91s 4.49s 4.49s 10/10
24 tensorlake 74.5 2.50s 2.64s 2.64s 10/10
25 modal 70.5 2.48s 3.64s 3.64s 10/10
26 codesandbox 64.7 3.22s 4.00s 4.00s 10/10
27 run-cloud 19.2 7.63s 8.76s 8.76s 10/10
28 hopx 0.0 0.00s 0.00s 0.00s 0/10
29 northflank 0.0 0.00s 0.00s 0.00s 0/10

View full run · SVGs available as build artifacts

@github-actions

github-actions Bot commented Sep 29, 2026 •

Copy link
Copy Markdown
Contributor

Sandbox Dax Benchmark Results

Provider Phases Total Prepare Clone Install Typecheck Status
archil 0/7 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
arker 7/7 60.86s 5.65s 2.07s 13.16s 34.64s 1/1 OK
beam 7/7 61.34s 17.34s 1.86s 10.55s 24.07s 1/1 OK
blaxel 7/7 46.20s 1.26s 1.80s 9.98s 24.91s 1/1 OK
cloud-run 2/7 0.73s 0.19s 0.00s 0.00s 0.00s 0/1 OK
cloudflare 2/7 120.59s 120.28s 0.00s 0.00s 0.00s 0/1 OK
codesandbox 0/7 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
createos 7/7 49.42s 4.21s 2.87s 13.62s 23.70s 1/1 OK
daytona 7/7 75.69s 5.49s 4.93s 13.08s 37.72s 1/1 OK
declaw 7/7 203.88s 5.84s 4.60s 27.68s 151.24s 1/1 OK
e2b 7/7 105.18s 19.32s 3.55s 22.13s 49.83s 1/1 OK
freestyle 0/7 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
givemeanode 7/7 41.89s 1.52s 2.52s 11.56s 22.89s 1/1 OK
hopx -- 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
isorun 7/7 35.37s 1.52s 1.11s 10.47s 18.75s 1/1 OK
microsandbox 7/7 50.84s 2.13s 2.14s 12.70s 25.79s 1/1 OK
miosa 0/7 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
modal 7/7 106.74s 3.47s 2.67s 23.66s 68.18s 1/1 OK
mosaic 7/7 59.27s 1.18s 2.45s 14.24s 30.18s 1/1 OK
namespace 7/7 49.56s 2.97s 1.62s 8.54s 20.58s 1/1 OK
northflank -- 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
opencomputer -- 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
run-cloud -- 0.00s 0.00s 0.00s 0.00s 0.00s 0/1 OK
runloop 7/7 102.22s 16.64s 12.38s 15.33s 51.16s 1/1 OK
sail 7/7 110.72s 5.85s 4.77s 26.17s 59.87s 1/1 OK
sandbox0 7/7 127.38s 4.13s 7.14s 74.34s 36.66s 1/1 OK
superserve 7/7 83.29s 8.00s 4.48s 14.88s 51.80s 1/1 OK
tenki 7/7 87.73s 5.83s 3.10s 21.91s 43.55s 1/1 OK
tensorlake 7/7 91.98s 19.55s 2.79s 18.61s 39.76s 1/1 OK
upstash 7/7 54.57s 4.30s 1.92s 10.52s 26.84s 1/1 OK
vercel 7/7 73.26s 13.72s 2.45s 12.09s 37.34s 1/1 OK

View full run

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant