Repository navigation
Blind v12: travel IDs, pedigree ages, spelled names, foreign addresses - #29
Merged
Merged
Conversation
Fictional Seattle clinic with a Regina office. Four blind authors wrote 100 messages each from a brief aimed at family history and genetics pedigrees, third-party reproduction paperwork, travel and cross-border care, speech-recognition errors, form and app exports, and minors with guardians. Two blind annotators per 100 messages and an adjudicator kept 70 corrections. Scored once against 650fe26 (0.1.0a13) before any change: 93.8% recall with all detectors (85.2% with regex + known entities). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Sergei Gorlovetsky <136336554+Sergei-gorlovetsky@users.noreply.github.com>
…gn addresses
IDs: travel booking and record-locator codes after a booking cue (five
languages and CJK), e-ticket numbers, passports after a passport cue,
foreign national IDs (Aadhaar, PhilSys, NIN, Belgian national number),
lawyers' bar and notary numbers, court cause numbers, insurance member
IDs in letter-digit groups, NHS and "My Number" values.
Ages and dates: ages over 89 after death and life words and after a
relative with an optional name, in English, Polish, Russian and
Ukrainian; Russian and Ukrainian day + month dates.
Names: Spanish and French letter-name spelling after a cue, Cyrillic
names and vocatives after cues, Japanese names in kanji after a name cue,
first names in time-stamped transcripts, pedigree markers.
Addresses: Philippine lot-and-block and barangay addresses with an
address context, UK street types and postcodes, Indian addresses with a
PIN, Mexican floor and door, reserve names after a cue, local postcode
cues, the clinic's own city when a patient lives there; schools and
universities as EMPLOYER in Spanish, French, Polish and Hebrew.
Removed during review because each could leave patient data visible: a
pass for URLs on the clinic's own domain, a phone exclusion near "NHS",
"the 4th floor" and lab-range ("3.5-12") date exclusions. A pedigree age
rule that ran in quadratic time on long blank runs is now linear.
v12 with clinic details and staff list: recall 93.7% -> 98.9%,
precision 88.1% -> 89.0%. No identifier the frozen 0.1.0a13 code caught
is missed on v0 to v12 in four configurations. Results files
regenerated, docs and a v12 CI gate added (1,792 tests).
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Sergei Gorlovetsky <136336554+Sergei-gorlovetsky@users.noreply.github.com>
Merged
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Results
Notes
🤖 Generated with Claude Code