Calibration runs exercise each verifier in the Source Network against a seed corpus of claims whose ground truth has been established independently. Precision is the share of positive verdicts that were correct; recall is the share of real positives that were caught. F1 combines the two. A verifier with a missing API key returns unverifiable on every claim and therefore scores n/a in the table below; the row is committed to make the key-missing code path legible, not because it represents the verifier's calibrated reliability. See the calibration hub for the run index and the methodology protocol. The underlying per-claim verdicts are published as raw_verdicts.json so the aggregation here is reproducible.
Source Network Calibration Report
- Corpus version: 0.1
- Corpus seeded: 2026-04-16
- Run started: 2026-11-05T14:25:53.296026+00:00
- Total claims: 33
- Stale ground-truth claims: 33 (see list at end)
Per-provider results (all claims)
| Provider |
N |
TP |
FP |
FN |
TN |
Precision |
Recall |
F1 |
| alpha_vantage |
4 |
1 |
0 |
1 |
2 |
1.00 |
0.50 |
0.67 |
| fred |
5 |
1 |
1 |
2 |
1 |
0.50 |
0.33 |
0.40 |
| rest_countries |
5 |
3 |
0 |
0 |
2 |
1.00 |
1.00 |
1.00 |
| sec_edgar |
5 |
2 |
0 |
1 |
2 |
1.00 |
0.67 |
0.80 |
| wikipedia |
6 |
4 |
0 |
0 |
2 |
1.00 |
1.00 |
1.00 |
| wolfram_alpha |
4 |
1 |
0 |
1 |
2 |
1.00 |
0.50 |
0.67 |
| world_bank |
4 |
2 |
0 |
0 |
2 |
1.00 |
1.00 |
1.00 |
Claim-level detail
| ID |
Provider |
Expected |
Observed |
Match |
Best source |
| sec-001 |
sec_edgar |
verified |
verified |
yes |
SEC Filing |
| sec-002 |
sec_edgar |
verified |
verified |
yes |
SEC Filing |
| sec-003 |
sec_edgar |
contradicted |
contradicted |
yes |
|
| sec-004 |
sec_edgar |
unverifiable |
unverifiable |
yes |
|
| sec-005 |
sec_edgar |
verified |
unverifiable |
no |
|
| fred-001 |
fred |
verified |
close |
yes |
FRED |
| fred-002 |
fred |
verified |
contradicted |
no |
|
| fred-003 |
fred |
contradicted |
contradicted |
yes |
|
| fred-004 |
fred |
unverifiable |
close |
no |
World Bank |
| fred-005 |
fred |
verified |
unverifiable |
no |
|
| rc-001 |
rest_countries |
verified |
verified |
yes |
World Bank |
| rc-002 |
rest_countries |
verified |
verified |
yes |
Wolfram Alpha |
| rc-003 |
rest_countries |
contradicted |
contradicted |
yes |
|
| rc-004 |
rest_countries |
verified |
verified |
yes |
World Bank |
| rc-005 |
rest_countries |
unverifiable |
unverifiable |
yes |
|
| wb-001 |
world_bank |
verified |
verified |
yes |
World Bank |
| wb-002 |
world_bank |
close |
close |
yes |
World Bank |
| wb-003 |
world_bank |
contradicted |
contradicted |
yes |
|
| wb-004 |
world_bank |
unverifiable |
unverifiable |
yes |
|
| av-001 |
alpha_vantage |
verified |
unverifiable |
no |
|
| av-002 |
alpha_vantage |
contradicted |
unverifiable |
no |
|
| av-003 |
alpha_vantage |
unverifiable |
unverifiable |
yes |
|
| av-004 |
alpha_vantage |
close |
verified |
yes |
SEC Filing |
| wa-001 |
wolfram_alpha |
verified |
verified |
yes |
Wikipedia |
| wa-002 |
wolfram_alpha |
verified |
unverifiable |
no |
|
| wa-003 |
wolfram_alpha |
contradicted |
unverifiable |
no |
|
| wa-004 |
wolfram_alpha |
unverifiable |
unverifiable |
yes |
|
| wiki-001 |
wikipedia |
verified |
verified |
yes |
Wikipedia |
| wiki-002 |
wikipedia |
verified |
verified |
yes |
Wikipedia |
| wiki-003 |
wikipedia |
verified |
verified |
yes |
Wolfram Alpha |
| wiki-004 |
wikipedia |
contradicted |
unverifiable |
no |
|
| wiki-005 |
wikipedia |
contradicted |
unverifiable |
no |
|
| wiki-006 |
wikipedia |
verified |
close |
yes |
Wikipedia |
Stale ground-truth claims
These claims have an as_of_date older than 90 days. Re-verify the primary source before treating their results as calibration signal.
sec-001
sec-002
sec-003
sec-004
sec-005
fred-001
fred-002
fred-003
fred-004
fred-005
rc-001
rc-002
rc-003
rc-004
rc-005
wb-001
wb-002
wb-003
wb-004
av-001
av-002
av-003
av-004
wa-001
wa-002
wa-003
wa-004
wiki-001
wiki-002
wiki-003
wiki-004
wiki-005
wiki-006