Skip to content

feat: documentation site, multi-cloud benchmarks, and harness fixes#30

Merged
bryantbiggs merged 3 commits into
mainfrom
feat/multi-cloud-bench
Apr 19, 2026
Merged

feat: documentation site, multi-cloud benchmarks, and harness fixes#30
bryantbiggs merged 3 commits into
mainfrom
feat/multi-cloud-bench

Conversation

@bryantbiggs

@bryantbiggs bryantbiggs commented Apr 18, 2026

Copy link
Copy Markdown
Member

Summary

  • Full documentation site (Astro) with getting started, configuration, CLI reference, registry guides, design docs, and performance benchmarks
  • Multi-cloud benchmark infrastructure: SSH replaces SSM, per-provider Terraform (bench/terraform/aws/), streamed output
  • Benchmark harness accuracy fixes: source blob byte counting, instance metadata, proxy header handling, competitor config corrections
  • Site assets: proper OG image (1200x630 with stats), favicon without corner artifacts, web manifest, WCAG AA contrast compliance (Lighthouse 100/100 across all categories)

Documentation site

  • Landing page with feature highlights and benchmark stats
  • Registry-specific guides (ECR, GHCR, GAR, ACR, Docker Hub, Chainguard)
  • Design docs (engine architecture, benchmarks, watch mode, findings log)
  • JSON-LD structured data, sitemap, robots.txt, 404 page with noindex

Benchmark infrastructure

Area Before After
Remote access SSM Session Manager SSH
CLI args --instance-id, --region --provider aws
Networking Private subnet + NAT gateway Public subnet, IP-locked SG
Progress Poll progress file via SSM Stream stdout over SSH
Results SSM send-command SCP
Terraform dir bench/terraform/ bench/terraform/aws/

Harness fixes

  • source_blob_bytes was 240,000x wrong (counted redirect bodies, not CDN data)
  • Proxy now preserves multi-value headers (insert -> append) for quay.io v1 manifest compat
  • regsync config switched from type:repository to per-tag type:image entries
  • regsync explicit mediaTypes to avoid Docker v1 manifest fallback on quay.io
  • 429 abort and --skip-registries flag for rate-limit resilience

Site assets

  • OG image: 1200x630 with benchmark stats (8x faster, 60% fewer bytes, 0 rate-limit errors)
  • Favicon: full-bleed gradient square (no rounded corners, no corner-fill hack)
  • Separate logo-mark.svg for site header (rounded rect preserved)
  • Apple touch icon and PWA PNGs: full-bleed for OS masking
  • Web manifest for Android/PWA
  • WCAG AA contrast: --pink and --color-text-on-dark-muted bumped to pass 4.5:1

Test plan

  • cargo fmt --check && cargo clippy -- -D warnings && cargo test (200 tests pass)
  • cd bench/terraform/aws && terraform init && terraform validate
  • Lighthouse: Performance 100, Accessibility 100, Best Practices 100, SEO 100
  • OG image renders correctly in link previews (iMessage, Slack, Twitter)
  • Favicon renders without corner artifacts in browser tabs (light + dark mode)

@bryantbiggs
bryantbiggs force-pushed the feat/multi-cloud-bench branch 10 times, most recently from 598ee4a to 6dc184e Compare April 19, 2026 19:39
@bryantbiggs bryantbiggs changed the title refactor: replace SSM with SSH for multi-cloud benchmarks feat: documentation site, multi-cloud benchmarks, and harness fixes Apr 19, 2026
@bryantbiggs
bryantbiggs force-pushed the feat/multi-cloud-bench branch from 5d52143 to 3adb591 Compare April 19, 2026 21:09
Astro-based documentation site with design docs, registry guides,
CLI reference, configuration, performance benchmarks, and Helm chart
docs. Includes CI workflow, site assets, and updated READMEs.
Restructure bench terraform for per-provider directories (aws/).
Add bench-remote streaming output, cloud-init readiness check,
multi-tool cold comparison with proxy JSONL validation. Fix 6
harness bugs: source_blob_bytes metric, regsync per-tag config,
quay.io v1 manifest mediaTypes, mount metric (existence checks
vs cross-repo), SCP nested directory, proxy multi-value headers.
Add --skip-registries flag and source 429 abort. Historical run
records archived to bench/results/{registry}.json.
@bryantbiggs
bryantbiggs force-pushed the feat/multi-cloud-bench branch from 3adb591 to 4035fa8 Compare April 19, 2026 21:12
First validated 3-tool benchmark after fixing 6 harness bugs.
c6in.4xlarge, us-east-1, quay.io + Docker Hub + cgr.dev + public ECR.
@bryantbiggs
bryantbiggs force-pushed the feat/multi-cloud-bench branch from 4035fa8 to 38234f2 Compare April 19, 2026 21:17
@bryantbiggs
bryantbiggs merged commit 8ed9619 into main Apr 19, 2026
11 checks passed
@bryantbiggs
bryantbiggs deleted the feat/multi-cloud-bench branch April 19, 2026 21:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant