Skip to content

Commit 606f11b

Browse files
openclaw-dvclaude
andcommitted
chore(publish): regenerate leaderboard.json + FINDINGS generated sections for #255 tranche
Regenerated on top of the merged subpop re-blend (#321). Five more vendors now carry a populated demographic_scorecard (5 dimensions x 10 cells each): GPT-4o-mini, Gemini 2.5 Flash, Llama 3.3 70B, SynthPanel (GPT-4o-mini), SynthPanel (Gemini Flash Lite). (site/public/data run-explorer artifacts are CI-generated, not committed.) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
1 parent d2bc3df commit 606f11b

2 files changed

Lines changed: 1145 additions & 302 deletions

File tree

FINDINGS.md

Lines changed: 13 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -134,32 +134,32 @@ t=0.85, 100 questions, 15–30 samples.
134134

135135
| Group | P_dist | P_cond | Replications |
136136
|-------|--------|--------|--------------|
137-
| Republican | 0.666 | **0.073 ± 0.004** | 4 |
138-
| Democrat | 0.644 | **0.033 ± 0.005** | 4 |
137+
| Republican | 0.680 | **0.099 ± 0.035** | 9 |
138+
| Democrat | 0.657 | **0.043 ± 0.023** | 9 |
139139

140140
#### INCOME
141141

142142
| Group | P_dist | P_cond | Replications |
143143
|-------|--------|--------|--------------|
144-
| $100K+ | 0.674 | **0.030 ± 0.004** | 3 |
145-
| <$30K | 0.596 | **0.019 ± 0.003** | 3 |
144+
| <$30K | 0.632 | **0.054 ± 0.033** | 8 |
145+
| $100K+ | 0.673 | **0.041 ± 0.025** | 8 |
146146

147147
#### EDUCATION
148148

149149
| Group | P_dist | P_cond | Replications |
150150
|-------|--------|--------|--------------|
151-
| Less than HS | 0.597 | **0.038** | 1 |
152-
| College graduate | 0.641 | **0.036** | 1 |
151+
| Less than HS | 0.642 | **0.081 ± 0.041** | 6 |
152+
| College graduate | 0.676 | **0.042 ± 0.026** | 6 |
153153

154-
Republican conditioning is **2.2× stronger** than Democrat (mean P_cond across replications).
155-
High-income conditioning is **1.5× stronger** than low-income.
154+
Republican conditioning is **2.3× stronger** than Democrat (mean P_cond across replications).
155+
High-income conditioning is **1.3× stronger** than low-income.
156156

157157
#### Other measured attributes
158158

159159
| Attribute | Group | P_dist | P_cond | Replications |
160160
|-----------|-------|--------|--------|--------------|
161-
| CREGION | South | 0.641 | 0.039 ± 0.005 | 2 |
162-
| CREGION | Northeast | 0.628 | 0.021 ± 0.004 | 2 |
161+
| CREGION | South | 0.651 | 0.055 ± 0.018 | 7 |
162+
| CREGION | Northeast | 0.657 | 0.045 ± 0.029 | 7 |
163163
| RACE | White | 0.785 | 0.141 ± 0.030 | 3 |
164164
| RACE | Hispanic | 0.605 | 0.034 ± 0.005 | 3 |
165165
| RACE | Asian | 0.637 | 0.025 ± 0.005 | 3 |
@@ -169,8 +169,8 @@ High-income conditioning is **1.5× stronger** than low-income.
169169
| RELIG | Hindu | 0.806 | 0.129 | 1 |
170170
| RELIG | Jewish | 0.774 | 0.127 | 1 |
171171
| RELIG | Atheist | 0.738 | 0.095 | 1 |
172-
| SEX | Male | 0.647 | 0.055 | 1 |
173-
| SEX | Female | 0.617 | 0.027 | 1 |
172+
| SEX | Female | 0.645 | 0.049 ± 0.036 | 6 |
173+
| SEX | Male | 0.665 | 0.048 ± 0.031 | 6 |
174174
<!-- END GENERATED: conditioning -->
175175

176176
### Key Findings
@@ -291,7 +291,7 @@ more temperature — it just adds noise.
291291
|-------|----------------------|------|--------|
292292
| **Ensemble blending** | +1.0–4.8 | zero | done |
293293
| **Per-model optimal temperature** | +0.8–4.5 | low | actionable |
294-
| **Demographic conditioning** | +1.9–7.3 | moderate | scientific |
294+
| **Demographic conditioning** | +4.1–9.9 | moderate | scientific |
295295
| **Persona template** | 'current' template already optimal (+11.0 pts over the best alternative); no further gain available from this lever. | zero | done |
296296
<!-- END GENERATED: levers -->
297297

0 commit comments

Comments
 (0)