Skip to content

Commit ab1ac4b

Browse files
authored
buildkit: deploy on meta-prod-aws-ue1 (us-east-1) (#728)
Stack from [ghstack](https://github.com/ezyang/ghstack/tree/0.15.0) (oldest at bottom): * #727 * __->__ #728 Same buildkit config as arc-cbr-production (ue2): m6id.24xlarge amd64 (2/node) + m7gd.16xlarge arm64 (4/node), autoscaling min 2/4, max 360/30, fallback 32/8. Adds keda + buildkit to the cluster's module list (keda provides the CRDs the autoscaling needs).
1 parent 333eb4d commit ab1ac4b

1 file changed

Lines changed: 17 additions & 2 deletions

File tree

osdc/clusters.yaml

Lines changed: 17 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -308,6 +308,19 @@ clusters:
308308
vpc_cidr: "10.4.0.0/16"
309309
node_compactor:
310310
min_node_age_seconds: 900
311+
buildkit:
312+
amd64_instance_type: m6id.24xlarge
313+
amd64_pods_per_node: 2
314+
arm64_instance_type: m7gd.16xlarge
315+
arm64_pods_per_node: 4
316+
autoscaling:
317+
enabled: true
318+
amd64_min: 2 # 1x m6id.24xlarge (2 pods/node)
319+
amd64_max: 360 # ~90d peak ≈180, x2 for headroom
320+
arm64_min: 4 # 1x m7gd.16xlarge (4 pods/node)
321+
arm64_max: 30 # ~90d peak ≈15, x2 for headroom
322+
amd64_fallback: 32 # if KEDA can't read metrics, hold the proven fixed pool
323+
arm64_fallback: 8
311324
arc-runners:
312325
github_config_url: "https://github.com/pytorch"
313326
github_secret_name: meta-prod-aws-ue1
@@ -320,6 +333,8 @@ clusters:
320333
- arc
321334
- nodepools
322335
- arc-runners
336+
- keda
337+
- buildkit
323338
- pypi-cache
324339
- cache-enforcer
325340
- zombie-cleanup
@@ -346,9 +361,9 @@ clusters:
346361
arm64_pods_per_node: 4
347362
autoscaling:
348363
enabled: true
349-
amd64_min: 32 # warm baseline = proven fixed pool (16x m6id.24xlarge)
364+
amd64_min: 2 # 1x m6id.24xlarge (2 pods/node)
350365
amd64_max: 360 # ~90d peak ≈180, x2 for headroom
351-
arm64_min: 8 # warm baseline = proven fixed pool (2x m7gd.16xlarge)
366+
arm64_min: 4 # 1x m7gd.16xlarge (4 pods/node)
352367
arm64_max: 30 # ~90d peak ≈15, x2 for headroom
353368
amd64_fallback: 32 # if KEDA can't read metrics, hold the proven fixed pool
354369
arm64_fallback: 8

0 commit comments

Comments
 (0)