Commit 01d148c
Claude Code
Fix STV (Stevenage): HTTPS migration and certificate verification bypass
The scraper was using http://democracy.stevenage.gov.uk which causes wreq to
attempt an IPv6 (AAAA) DNS lookup that returns ServFail from Stevenage's DNS
server, causing a hard failure. Switching to https:// bypasses this path.
The https:// endpoint has an untrusted certificate (not in wreq's BoringSSL
bundle), so verify_requests = False is also needed to allow the connection.
With both changes the ModGov ASMX endpoint returns valid XML: 39 councillors,
39 with photos, 0 emails (council does not publish email addresses via ModGov).1 parent 8762213 commit 01d148c
2 files changed
Lines changed: 2 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2 | 2 | | |
3 | 3 | | |
4 | 4 | | |
5 | | - | |
| 5 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
14 | 14 | | |
15 | 15 | | |
16 | 16 | | |
17 | | - | |
| 17 | + | |
18 | 18 | | |
19 | 19 | | |
20 | 20 | | |
| |||
0 commit comments