Skip to content

Commit 90aa8df

Browse files
HetCreepclaude
andcommitted
docs: sibling-consistency + honesty fixes (R4-8)
README: section canon, metaphor blockquote, status into core trio, Benchmark headline (20/20 +1-rung; ~70-75% savings) + link (removed unsourced routing-decision numbers), Ships typo. SECURITY: scans 'event-driven' not 'each release'. CONTRIBUTING: --follow-tags + stable-tags-only. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
1 parent 34e7e15 commit 90aa8df

3 files changed

Lines changed: 16 additions & 34 deletions

File tree

CONTRIBUTING.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -59,7 +59,7 @@ CoalTipple is **Claude Code only**. Routing actuates only where an agent can pic
5959

6060
## 🚀 Releasing (Maintainers)
6161

62-
Bump version in `.claude-plugin/plugin.json` ➡️ Add changelog entry in `CHANGELOG.md` ➡️ Ensure `verify.mjs` and `test.mjs` pass ➡️ Commit ➡️ Create signed git tag (`vX.Y.Z`) ➡️ Push ➡️ Create a GitHub Release.
62+
Bump version in `.claude-plugin/plugin.json` ➡️ Add a changelog entry in `CHANGELOG.md` ➡️ Ensure `verify.mjs` and `test.mjs` pass ➡️ Commit ➡️ Create a signed git tag (`vX.Y.Z`) ➡️ Push `--follow-tags` ➡️ Create a GitHub Release (stable tags only).
6363

6464
---
6565

README.md

Lines changed: 14 additions & 32 deletions
Original file line numberDiff line numberDiff line change
@@ -2,28 +2,30 @@
22

33
# 🚂 CoalTipple
44

5+
> A *tipple* is the sorting-and-rail-switching station of a coal mine — this one switches rails for prompts across models.
6+
57
**A model/effort router for Claude Code** — delegate a task you *can* do but that is large and cheap *down* to a cheaper tier to save tokens, and hand a task beyond your reach *up* to a stronger tier for quality.
68

79
![version](https://img.shields.io/github/v/tag/TheColliery/CoalTipple?label=version&color=blue)
810
![license](https://img.shields.io/badge/license-MIT-blue)
11+
![status](https://img.shields.io/badge/status-live-brightgreen)
912
![SKILL.md](https://img.shields.io/badge/SKILL.md-open_standard-success)
1013
![Claude Code](https://img.shields.io/badge/Claude_Code-validated-success)
11-
![status](https://img.shields.io/badge/status-live-brightgreen)
1214

13-
[Changelog](CHANGELOG.md) · [Security](SECURITY.md) · [Privacy](PRIVACY.md) · [Releases](https://github.com/TheColliery/CoalTipple/releases)
15+
[Benchmark](https://github.com/TheColliery/.github/tree/main/benchmarks/CoalTipple) · [Contributing](CONTRIBUTING.md) · [Changelog](CHANGELOG.md) · [Security](SECURITY.md) · [Privacy](PRIVACY.md) · [Releases](https://github.com/TheColliery/CoalTipple/releases)
1416

1517
**Part of [TheColliery](https://github.com/TheColliery)** — siblings: **[CoalMine](https://github.com/HetCreep/CoalMine)** (quality canaries) · **[CoalBoard](https://github.com/TheColliery/CoalBoard)** (consensus & debate board).
1618

1719
</div>
1820

19-
**Live -- in real use on Claude Code.** The v1 core is validated on **Claude Code** (across the 2.1.x line) and active; the conductor hook fires a routing forcer on every prompt.
21+
---
2022

2123
> [!CAUTION]
2224
> **Claude Code only.** CoalTipple's routing only actuates where an agent can pick a spawned worker's model + effort. Today that is **Claude Code**. **Antigravity does NOT work** -- its subagents inherit the parent's model (no per-spawn model parameter, no separate effort knob), so routing cannot actuate there. Other platforms (Codex, Cursor, ...) are under monthly review.
2325
2426
---
2527

26-
## 🚂 What CoalTipple is
28+
## 🚂 What it is
2729

2830
A *tipple* is the sorting-and-rail-switching station of a coal mine. This tool switches rails for **prompts across models** (alongside [CoalMine](https://github.com/HetCreep/CoalMine)).
2931

@@ -47,7 +49,7 @@ You are **main**. CoalTipple decides, per task, whether to:
4749

4850
---
4951

50-
## 🚀 Installation
52+
## 🚀 Install
5153

5254
### Claude Code plugin
5355

@@ -120,9 +122,9 @@ Workers start context-fresh. A **memory anchor** file gives a fresh worker proje
120122

121123
---
122124

123-
## ⚙️ Configuration (.coaltipple.json)
125+
## ⚙️ Configure
124126

125-
Shops zero-config with optimal defaults. Precedence: **project override → global config → schema default**.
127+
Ships zero-config with optimal defaults in `.coaltipple.json`. Precedence: **project override → global config → schema default**.
126128

127129
Key settings (see [`scripts/lib/config-schema.mjs`](scripts/lib/config-schema.mjs) for the full SSoT schema):
128130

@@ -147,34 +149,14 @@ node scripts/configure.mjs --help # view all schema-drive
147149

148150
---
149151

150-
## 📊 Benchmark — Routing & Output Correctness
151-
152-
We evaluate both routing decisions (the Lock and probe tasks) and final output correctness:
153-
154-
**Routing Decisions (Measured 2026-06-14/15, CoalTipple v1.0.3):**
155-
156-
| Probe Task | What it Evaluates | Pass Rate |
157-
|---|---|---|
158-
| **A: Delegate-down** | Large, mechanical tasks offloaded correctly | **7 / 7 tiers** |
159-
| **B: Sensitive safety** | Crypto/auth tasks stay on heavy/main tier | **7 / 7 tiers** |
160-
| **C: Escalate-up** | Tasks beyond main's tier escalate for quality | **7 / 7 tiers** |
161-
| **D: Context routing** | Right model capacity mapped correctly | **7 / 7 tiers** |
162-
| **Lock ranking** | Correct tier order classification | **5 / 7 tiers** |
163-
164-
**Output Correctness (+1 Rung Escalation):**
165-
166-
| Main Model | Escalation Rung | Task Domains (Crypto, Proof, Research, Legal, Voice) | Output Pass Rate |
167-
|---|---|---|---|
168-
| `Haiku` | ➡️ `Sonnet` | 5/5 tasks | **100%** |
169-
| `Sonnet` | ➡️ `Opus` | 5/5 tasks | **100%** |
170-
| `Opus 4.6` | ➡️ Self-inline | 5/5 tasks | **100%** |
171-
| `Opus 4.7` | ➡️ Self-inline | 5/5 tasks | **100%** |
152+
## 📊 Benchmark
172153

173-
*Total: 20/20 PASS deliverables generated correctly.*
154+
We evaluate the **final output correctness** after the main escalates one rung, and the **token savings** of delegating mechanical bulk down — each dated, on small honest samples, never inlined here so a copied number cannot drift.
174155

175-
**Routing Savings (Measured 2026-06-19):** main does it itself vs delegates a big mechanical task (a 12-handler API scaffold) to a cheap worker — **~70–75% cheaper** to delegate down (Opus is 5× Haiku per token; the cheap tier also ran terser, 51k vs 71k tokens). The saving holds only **above** the `delegateMinLines` floor (a small task costs more to hand off than to do inline) and **never** applies to sensitive work (the hard gate). Detail: [`benchmarks/CoalTipple/ROUTING-SAVINGS.md`](https://github.com/TheColliery/.github/blob/main/benchmarks/CoalTipple/ROUTING-SAVINGS.md).
156+
* **Output correctness (+1-rung escalation):** **20/20** — every main, escalating one rung, delivered correctly across all 5 domains (crypto · proof · research · legal · voice; measured 2026-06-15, v1.0.3).
157+
* **Routing savings:** delegating a big mechanical task down from Opus to a cheaper tier ran **~70–75% cheaper** — holding only above the `delegateMinLines` floor and never on sensitive work (measured 2026-06-19, version-sensitive rates).
176158

177-
The full benchmark harnesses (tasks, scorer, results) live in the series umbrella at [`TheColliery/.github/benchmarks/CoalTipple`](https://github.com/TheColliery/.github/tree/main/benchmarks/CoalTipple).
159+
Full harnesses, per-task scoring, and the dated figures live in the series umbrella: [`TheColliery/.github/benchmarks/CoalTipple`](https://github.com/TheColliery/.github/tree/main/benchmarks/CoalTipple) ([output-quality RESULTS](https://github.com/TheColliery/.github/blob/main/benchmarks/CoalTipple/RESULTS.md) · [routing savings](https://github.com/TheColliery/.github/blob/main/benchmarks/CoalTipple/ROUTING-SAVINGS.md)).
178160

179161
---
180162

SECURITY.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# Verifying CoalTipple
22

3-
CoalTipple is verified under the same framework as **[CoalMine](https://github.com/HetCreep/CoalMine/blob/main/SECURITY.md)**: all execution hooks follow the [Phoenix-13 commandments](https://github.com/TheColliery/.github/blob/main/hooks-safety.md), builds are fully reproducible from source, and security scans run on each release.
3+
CoalTipple is verified under the same framework as **[CoalMine](https://github.com/HetCreep/CoalMine/blob/main/SECURITY.md)**: all execution hooks follow the [Phoenix-13 commandments](https://github.com/TheColliery/.github/blob/main/hooks-safety.md), builds are fully reproducible from source, and security scans run periodically (event-driven).
44

55
---
66

0 commit comments

Comments
 (0)