← Back to Reliability Explorer
Measured selection evidence
external-gold-v1:Reddit
Measured historical tool-selection reliability from frozen benchmark evidence.
Single-batchS2-backedVersion-bound
Version-bound source snapshot. Historical evidence does not establish current endpoint availability or current production behavior. Check observation freshness and schema changes.
1independent benchmark batches
2measured frozen cases
S2evidence level(s)
0observed semantic misses
First measurement: 2026-09-09 22:51:26.259023 UTC · Last measurement: 2026-09-09 22:51:26.259023 UTC · Observed strict accuracy range: 100.0%–100.0%
Batch history
Each immutable benchmark batch is shown separately. No pooled accuracy is calculated here.
| Benchmark / batch | Type | Frozen cases | Strict score | Wilson 95% CI | Provider-valid coverage | Infrastructure failures | Evidence / measured |
|---|---|---|---|---|---|---|---|
external-gold-v1external-gold-v1 |
EXTERNAL_INDEPENDENT_GOLD_BENCHMARK | 2 | 2/2 100.0% |
34.2%–100.0% | 2 / 2 (100.0%) | 0 | S2 2026-09-09 22:51:26.259023 UTC |
Observed semantic misses
These are preserved adjudicated historical observations, attributable to a benchmark, batch, and case.
| Benchmark / batch | Case ID | Expected tool | Selected tool | Boundary family | Adjudication |
|---|---|---|---|---|---|
| No observed semantic misses in current evidence. This is not proof that no failures occurred. | |||||
Evidence provenance
Technical identities are secondary detail for auditability.
Reddit
- Canonical subject ID
external-gold-v1:Reddit- Provenance type
- EXTERNAL_INDEPENDENT_GOLD_BENCHMARK
- Identity mode
- VERSION_BOUND_SNAPSHOT
- Identity source
VERSION_BOUND_RECONSTRUCTED_SOURCE_SNAPSHOT
external-gold-v1 immutable identities
- case_freeze_sha256
c28335eb68a5b82456ed11593a8cf589ca75d0cf9802ce570b0e46f5b1716d71- final_verification_receipt_sha256
6e5a58b37b7f4a22f89db28ddbb64a187c377220f9593fcb555c821aa0baf176- measurement_artifact_sha256
1f248ea7a423fc49b03aece1fa16d7d4e5a8b488985787b6f702a31cd1db7e33- measurement_manifest_sha256
d7323f18ad5e642986bae0534d31fca1b877b2f3fa70764649051d7721003ecd- model_lock_sha256
64e9fb5e6a9ab6fb2d72172168c13877c60645ac336b1b4fceacc8eb8219da11