Source Network calibration

The Frame Check Source Network combines multiple authoritative- data verifiers (SEC EDGAR, World Bank, FRED, REST Countries, CoinGecko, Alpha Vantage, Wolfram Alpha, Wikipedia, Brave Search). Each verifier has different precision and recall characteristics on different claim types. Calibration measures those characteristics against a seed corpus of claims whose ground truth has been established independently, so that per-provider reliability can be reported alongside verification results rather than hidden.

The calibration methodology lives in the methodology. The seed corpus and the harness source are in the repository at calibration/.

Published runs

• detector_empirics_2026-05-01corpus v, claims, started
• detector_empirics_2026-04-30corpus v, claims, started
• detector_empirics_2026-04-29corpus v, claims, started
• 2026-04-17-wikipediacorpus v0.1, 6 claims, started 2026-04-17T18:18:17.401056+00:00
• 2026-04-17-full-with-wikicorpus v0.1, 33 claims, started 2026-04-17T18:20:10.081105+00:00
• 2026-04-17-full-keyscorpus v0.1, 27 claims, started 2026-04-17T14:17:28.208584+00:00
• 2026-04-16-first-runcorpus v0.1, 27 claims, started 2026-04-16T15:15:51.268350+00:00

Each run writes a raw JSON record of observed verdicts alongside the report. Runs that exercised a verifier without its API key are committed with n/a F1 values so the key- missing code path is legible; re-running with keys configured produces calibrated rows that replace the n/a entries.