forecastbench

Phase 0 benchmark contract for binary forecasting.

Scope

Phase 0 defines schemas, file formats, CLI contracts, and benchmark hashing/versioning. Ingestion/scoring logic remains stubbed.

Install

pip install -e .[dev]

CLI

forecastbench --help
forecastbench ingest --source EXAMPLE --out data/processed/processed.parquet
forecastbench split --strategy time --out data/splits
forecastbench run --split val --adapter stub --agent-config configs/agent.json --out runs
forecastbench score --run runs/run_YYYYMMDDTHHMMSSZ
forecastbench report --run runs/run_YYYYMMDDTHHMMSSZ

Contract docs

• docs/PROTOCOL.md
• docs/DATA_LAYOUT.md
• docs/RUN_FORMAT.md