Repository navigation
Bootstrap: scope of the shared tools library #1
Description
tools-commons holds code shared by the BenchCommons tools (ADR 0005 in .product), so they stop copying it between repos.
Candidates, to decide in spec 001:
- Contract checkers: catalog contract validation (tools-benchmark spec 010,
check_catalog.py) and input contract validation (tools-dataset spec 001). - Common helpers already duplicated:
changed --sinceselection of implementation folders (catalog-algorithmshello.py, catalog-web-frameworkscatalog.py), retry wrappers for flaky downloads, Docker run helpers. - Packaging: language (Python 3.12, as tools-benchmark and tools-dataset) and how tools pin a version (release tag, or a git dependency by commit).
- CI: unit tests plus the org docs CI.
Activity
matbrgz commentedon Oct 12, 2026
For the "retry wrappers for flaky downloads" candidate: tools-dataset already has this code, in the source toolkit of spec 004 (PR tools-dataset#7), ported from dataset-names.
datasettool.sources.cache.fetch_resource: cache at<cache>/<source_id>/<file>with.meta.json(url, time, sha256, size), User-Agent per project, up to three attempts with doubling backoff, no retry on 4xx except 408 and 429, atomic writes through.part, Content-Length check,BlockedErrorfor an HTML page served instead of a file, manual-download hint on 403, offline and refresh modes. Tested against a local HTTP server only.