Skip to content

Commit d1764a6

Browse files
jeremymanningclaude
andcommitted
docs: honest accounting of spec 004 status — distinguish verified from scaffolded
Reflect the truth after direct code verification rather than spec-level claims. - CLAUDE.md: replace 'Remaining Stubs: None' with a detailed list of 16 known scaffolding-with-placeholder items (mesh LLM load_model, zero-placeholder cert fingerprints, zero-placeholder Rekor pubkey, Firecracker rootfs, admin::ban stub, unexercised adapters, never-built GUI, never-built Docker/Helm, unbound REST gateway, non-kill-rejoin churn simulator, never-built Apple VF helper, structural-only receipt verify, stub current_load). Update test count 784 -> 802. Update 'Recent Changes' to separate fully-addressed from partially-addressed work. - README.md: rewrite status notice. Replace 'complete functional implementation' framing with explicit lists of (1) verified-in-code systems, (2) scaffolded systems with placeholder values in critical paths, (3) the critical open issue #60 for cross-machine WAN operation behind institutional firewalls. - specs/001-world-compute-core/whitepaper.md: add v0.4 entry correcting v0.3's overstatement. List scaffolded-but-placeholder items explicitly. - notes/session-2026-04-18-production-networking-and-honest-accounting.md: session notes. What landed, what didn't, how we triaged issues, lessons. No code changes — documentation only. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
1 parent c60d769 commit d1764a6

5 files changed

Lines changed: 135 additions & 53 deletions

File tree

.omc/project-memory.json

Lines changed: 12 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -191,6 +191,12 @@
191191
"lastAccessed": 1776521491483,
192192
"type": "directory"
193193
},
194+
{
195+
"path": "CLAUDE.md",
196+
"accessCount": 14,
197+
"lastAccessed": 1776571088041,
198+
"type": "file"
199+
},
194200
{
195201
"path": "src/policy/rules.rs",
196202
"accessCount": 13,
@@ -215,12 +221,6 @@
215221
"lastAccessed": 1776433723313,
216222
"type": "file"
217223
},
218-
{
219-
"path": "CLAUDE.md",
220-
"accessCount": 7,
221-
"lastAccessed": 1776434783783,
222-
"type": "file"
223-
},
224224
{
225225
"path": "adapters/cloud/src/main.rs",
226226
"accessCount": 7,
@@ -245,6 +245,12 @@
245245
"lastAccessed": 1776522312063,
246246
"type": "file"
247247
},
248+
{
249+
"path": "specs/001-world-compute-core/whitepaper.md",
250+
"accessCount": 6,
251+
"lastAccessed": 1776571166101,
252+
"type": "file"
253+
},
248254
{
249255
"path": "src/policy/engine.rs",
250256
"accessCount": 5,
@@ -287,12 +293,6 @@
287293
"lastAccessed": 1776402206140,
288294
"type": "file"
289295
},
290-
{
291-
"path": "specs/001-world-compute-core/whitepaper.md",
292-
"accessCount": 4,
293-
"lastAccessed": 1776434843075,
294-
"type": "file"
295-
},
296296
{
297297
"path": "specs/003-stub-replacement/tasks.md",
298298
"accessCount": 3,

CLAUDE.md

Lines changed: 23 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,10 @@
11
# world-compute Development Guidelines
22

3-
Last updated: 2026-04-17
3+
Last updated: 2026-04-18
44

55
## Project Overview
66

7-
World Compute is a decentralized, volunteer-built compute federation. The codebase is a Rust workspace with 150+ source files, 784+ passing tests, and 20 library modules. All 5 CLI command groups are functional (donor, job, cluster, governance, admin). Core modules implemented: WASM sandbox with CID store integration, real Ed25519 signature verification, certificate chain validation (TPM2/SEV-SNP/TDX), BrightID/OAuth2/phone identity verification, Sigstore Rekor transparency logging, OTLP telemetry, STUN-based NAT detection, Raft coordinator consensus, and Firecracker/Apple VF sandbox drivers.
7+
World Compute is a decentralized, volunteer-built compute federation. The codebase is a Rust workspace with 150+ source files, 802 passing tests, and 20 library modules. All 5 CLI command groups are functional (donor, job, cluster, governance, admin). Production P2P daemon with full libp2p NAT-traversal stack (TCP + QUIC, Noise, mDNS + Kademlia DHT, identify, ping, AutoNAT, Relay v2 server+client, DCUtR) and distributed job dispatch (TaskOffer + TaskDispatch request-response with CBOR + real WASM execution) — validated end-to-end in-process via `tests/nat_traversal.rs`. Core modules implemented: WASM sandbox with CID store integration, real Ed25519 signature verification, certificate chain validation (TPM2/SEV-SNP/TDX), BrightID/OAuth2/phone identity verification, Sigstore Rekor transparency logging, OTLP telemetry, STUN-based NAT detection, Raft coordinator consensus, and Firecracker/Apple VF sandbox drivers.
88

99
## Active Technologies
1010
- Rust stable (tested on 1.95.0) + libp2p 0.54, tonic 0.12, ed25519-dalek 2, wasmtime 27, openraft 0.9, opentelemetry 0.27, clap 4 (003-stub-replacement)
@@ -69,7 +69,7 @@ gui/src-tauri/ # Tauri GUI scaffold
6969

7070
```sh
7171
# Build and test
72-
cargo test # 784+ tests (500+ lib + 284+ integration)
72+
cargo test # 802 tests (500+ lib + 300+ integration)
7373
cargo clippy --lib -- -D warnings # Zero warnings enforced
7474

7575
# Build only
@@ -111,9 +111,25 @@ The project is governed by a ratified constitution at `.specify/memory/constitut
111111
4. **Efficiency & Self-Improvement** — energy-aware scheduling, mesh LLM
112112
5. **Direct Testing** — real hardware tests required, no mocks for production
113113

114-
## Remaining Stubs
115-
116-
**None** — all implementation stubs have been replaced as of spec 004-full-implementation. Zero TODO comments remain in src/. Zero `#[ignore]` tests remain.
114+
## Remaining Stubs and Placeholders
115+
116+
Zero TODO comments in src/ and zero `#[ignore]` tests remain. However, several subsystems have scaffolding landed but placeholders in critical paths — these are not production-ready and are tracked in open issues:
117+
118+
- **Mesh LLM** (#27, #54): `src/agent/mesh_llm/expert.rs::load_model()` is a placeholder — no real LLaMA inference. Orchestration (router, aggregator, safety tiers, kill switch) is complete.
119+
- **AMD / Intel root CA fingerprints** (#28): pinned as `[0u8; 32]` in `src/verification/attestation.rs`. Validators enter permissive bypass mode when fingerprints are zero.
120+
- **Rekor public key** (#29): pinned as `[0u8; 32]` in `src/ledger/transparency.rs`. Signed tree head verification is skipped when the key is zero.
121+
- **Agent lifecycle → gossip wiring** (#30): heartbeat/pause/withdraw return payloads but don't broadcast over gossipsub (the daemon event loop does broadcast separately).
122+
- **Firecracker rootfs** (#33): concatenates layer bytes; does NOT run mkfs.ext4 + OCI tar extraction. A real boot would fail.
123+
- **Admin `ban()`** (#34): `src/governance/admin_service.rs::ban()` returns `Ok(())` without updating the trust registry.
124+
- **Platform adapters** (#37, #38, #39): Slurm/K8s/Cloud scaffolds exist but have not been exercised against live systems.
125+
- **GUI** (#40): never built or run.
126+
- **Deployment** (#41): Dockerfile and Helm chart exist but have never been built or deployed.
127+
- **REST gateway** (#43): routing + auth + rate-limit logic exist but no HTTP listener is bound in the daemon.
128+
- **Churn simulator** (#51): statistical model, not a real kill-rejoin harness.
129+
- **Apple VF Swift helper** (#52): never built on macOS.
130+
- **Receipt verification** (`src/verification/receipt.rs`): structural check only; coordinator public key not yet wired.
131+
- **Daemon `current_load()`** (`src/agent/daemon.rs:500`): stub returning 0.1.
132+
- **Cross-machine firewall traversal** (#60): production NAT stack validated in-process only. Real WAN operation behind institutional firewalls is unverified.
117133

118134
## CI
119135

@@ -123,6 +139,6 @@ Two GitHub Actions workflows:
123139

124140
## Recent Changes
125141

126-
- **004-full-implementation** (2026-04-17): Complete functional implementation (#57, #28#56). 211 tasks, 784+ tests. Deep cryptographic attestation, agent lifecycle, preemption supervisor, policy engine completion, GPU passthrough, Firecracker rootfs, incident containment, adversarial tests, confidential compute, mTLS, threshold signing, CRDT ledger, scheduler matchmaking, credit decay, storage GC, platform adapters (Slurm/K8s/Cloud/Apple VF), Tauri GUI, REST gateway, mesh LLM, Docker/Helm deployment, energy metering.
142+
- **004-full-implementation** (2026-04-18): Merged scaffolding + significant implementation for #57 and its sub-issues (#28–#56, and a first pass on #27/#54 mesh LLM). 802 tests passing across Linux/macOS/Windows + Sandbox KVM + swtpm CI. Landed: full production P2P daemon with libp2p NAT-traversal stack (TCP + QUIC + Noise + mDNS + Kademlia + identify + ping + AutoNAT + Relay v2 server/client + DCUtR), AutoRelay reservations, public libp2p bootstrap relays as default rendezvous, TaskOffer + TaskDispatch request-response protocols over CBOR, real WASM execution of dispatched jobs, `worldcompute job submit --executor <multiaddr> --workload <wasm>` CLI command, end-to-end 3-node relay-circuit integration test. Also landed: ~12 sub-issues fully completed (policy engine, GPU passthrough, adversarial tests, test coverage, credit decay, preemption, confidential compute, mTLS, energy metering, storage GC, documentation, scheduler matchmaking); ~16 sub-issues partially addressed with scaffolding (see Remaining Stubs above); #27/#54 mesh LLM orchestration shell complete but real LLaMA inference deferred. Critical open issue #60 tracks cross-machine WAN mesh formation behind firewalls.
127143
- **003-stub-replacement** (2026-04-16): Replaced all implementation stubs (#7, #8#26). 77 tasks, 489+ tests. Added reqwest, oauth2, x509-parser, rcgen dependencies. Wired CLI, sandboxes, attestation, identity, transparency, telemetry, consensus, network.
128144
- **002-safety-hardening** (2026-04-16): Red team review (#4). Policy engine, attestation, governance, incident response, egress, identity hardening. 110 tasks, PR #6.

README.md

Lines changed: 34 additions & 31 deletions
Original file line numberDiff line numberDiff line change
@@ -9,39 +9,42 @@
99

1010
---
1111

12-
> **Status notice (updated 2026-04-17)**
12+
> **Status notice (updated 2026-04-18)**
1313
>
14-
> This repository contains a ratified governing constitution, a full research package (~28,600 words), detailed feature specifications, and a comprehensive implementation with **784+ passing tests** across all modules. The CLI is functional with all 5 command groups wired. Core systems are implemented end-to-end.
14+
> This repository contains a ratified governing constitution, a full research package (~28,600 words), detailed feature specifications, and a substantial implementation with **802 passing tests** across all modules on Linux/macOS/Windows CI. Core systems and the P2P daemon are wired and exercised by unit + integration tests. **However, several subsystems have production scaffolding with placeholder values in critical paths — they are NOT production-ready as shipped.** The open GitHub issues track which pieces remain.
1515
>
16-
> **What exists and works:**
17-
> - Library crate with 784+ passing tests (500+ lib, 284+ integration)
18-
> - All 5 CLI command groups functional (donor, job, cluster, governance, admin)
19-
> - WASM sandbox with CID store integration and real workload execution
20-
> - Firecracker microVM driver with rootfs preparation from OCI images
21-
> - Full cryptographic attestation (TPM2/SEV-SNP/TDX with RSA/ECDSA chain verification)
22-
> - Deterministic 10-step policy engine with artifact registry and egress allowlist
23-
> - Agent lifecycle: heartbeat, pause/checkpoint, withdrawal with zero host residue
24-
> - Preemption supervisor with sub-10ms SIGSTOP delivery
25-
> - BrightID, OAuth2, and phone/SMS identity verification
26-
> - Sigstore Rekor transparency logging with Merkle inclusion proof verification
27-
> - Raft consensus, CRDT ledger, BLS threshold signing (3-of-5)
28-
> - Scheduler with ClassAd matchmaking and R=3 disjoint-AS placement
29-
> - All 8 adversarial test scenarios fully implemented
30-
> - Confidential compute (AES-256-GCM + X25519 key wrapping)
31-
> - mTLS certificate management with 90-day auto-rotation
32-
> - Distributed mesh LLM (router, aggregator, self-prompting, safety tiers, kill switch)
33-
> - Platform adapters: Slurm, Kubernetes (with Helm chart), Cloud (AWS/GCP/Azure)
34-
> - Tauri desktop GUI scaffold with React frontend
35-
> - REST/HTTP+JSON gateway for all 6 gRPC services
36-
> - Docker + Docker Compose + Helm deployment infrastructure
37-
> - Energy metering (RAPL) and carbon footprint reporting
38-
> - CI on Linux/macOS/Windows via GitHub Actions (all green)
16+
> **What is complete and verified in code:**
17+
> - P2P daemon: full libp2p NAT-traversal stack (TCP + QUIC + Noise + mDNS + Kademlia + identify + ping + AutoNAT + Relay v2 server/client + DCUtR). Validated end-to-end in-process by `tests/nat_traversal.rs` — a 3-node relay-circuit test that dispatches a real WASM job through the relay in ~5ms.
18+
> - Distributed job dispatch: TaskOffer and TaskDispatch request-response protocols over CBOR. Real WASM execution on the executor. `worldcompute job submit --executor <multiaddr> --workload <wasm>` CLI command for end-to-end remote dispatch.
19+
> - All 5 CLI command groups functional
20+
> - WASM sandbox with CID-store integration and real workload execution (wasmtime)
21+
> - Deterministic 10-step policy engine with artifact registry + egress allowlist
22+
> - Preemption supervisor with SIGSTOP via nix (measured and logged)
23+
> - BrightID / OAuth2 / phone identity verification
24+
> - Scheduler with ClassAd matchmaking + R=3 disjoint-AS placement
25+
> - All 8 adversarial test scenarios implemented
26+
> - Confidential compute: AES-256-GCM + X25519 key wrapping
27+
> - mTLS certificate lifecycle via rcgen + Ed25519 auth tokens
28+
> - Credit decay with 45-day half-life + anti-hoarding
29+
> - Storage GC + acceptable-use filter + shard residency enforcement
30+
> - Energy metering via Intel RAPL
31+
> - 802 tests passing on CI (Linux/macOS/Windows + Sandbox KVM + swtpm)
3932
>
40-
> **What needs real-hardware validation (next milestone):**
41-
> - Multi-machine LAN testnet (Phase 1: 3+ physical machines)
42-
> - 72-hour churn simulation at 30% node failure rate
43-
> - GPU mesh LLM inference at scale (4+ GPU nodes)
44-
> - Preemption latency measurement on production hardware
33+
> **What has scaffolding but placeholder values or missing integration (see issues):**
34+
> - Mesh LLM (#27, #54): orchestration + router + aggregator + safety + kill switch all exist, but `load_model()` is a placeholder — no real LLaMA inference yet
35+
> - Attestation root CA fingerprints (#28): AMD ARK / Intel DCAP pinned as `[0u8; 32]` (bypass mode) — need real fingerprints before production
36+
> - Rekor public key (#29): pinned as `[0u8; 32]` — tree-head signature verification is skipped
37+
> - Firecracker rootfs (#33): concatenates layer bytes; real mkfs.ext4 + OCI-layer extraction not yet wired
38+
> - Platform adapters #37/#38/#39 (Slurm, K8s, Cloud): scaffolds + parsers; not exercised against live systems
39+
> - Tauri GUI (#40): scaffold; never built or run
40+
> - Docker / Helm deployment (#41): files present; never built or deployed
41+
> - REST gateway (#43): routing + auth logic present; no HTTP listener bound in daemon
42+
> - Admin ban (#34): `admin_service::ban()` is an explicit stub returning `Ok(())`
43+
> - Churn simulator (#51): statistical model; no real kill-rejoin
44+
> - Apple VF Swift helper (#52): scaffold; never built on macOS
45+
>
46+
> **Critical open issue:**
47+
> - #60: cross-machine firewall traversal. The production NAT stack is validated in-process only. Real WAN operation behind institutional / corporate firewalls is unverified, and our attempts from behind Dartmouth's firewall showed libp2p connections not completing. Resolving this is the next milestone.
4548
>
4649
> If you want to help build or test it, see [Contributing](#contributing).
4750
@@ -98,7 +101,7 @@ Five constitutional principles govern every design decision. They are not aspira
98101

99102
## Status
100103

101-
World Compute has completed full functional implementation across all modules with 784+ passing tests. All 5 CLI command groups are wired and functional. Updated 2026-04-17.
104+
World Compute has substantial implementation with 802 passing tests and a fully-wired P2P daemon. All 5 CLI command groups functional. Several subsystems still have placeholder values in critical paths (see status notice at top of README and open issues #27, #28, #29, #33, #34, #37#43, #51#54, #56, #60). Updated 2026-04-18.
102105

103106
### Design artifacts (complete)
104107

0 commit comments

Comments
 (0)