EF · Evidence fidelity
Traces code over a misleading comment (paired, B arm)
Gemma 4 31B QAT
Finding:HOLDS· grade C(research conclusion)
100% correct (10/10)
Pass rate
100%
What the few failures have in common
No failures recorded in the trials behind this row.
Evidence
- Ground truthDeterministic simulation: the right answer is computed, not judged
- StatisticsWilson 95% interval 72%–100%
- Sample size10 scored trials in total: small sample (under 15)
- Fresh-seed confirmationNot run yet
- ReplicationNot run yet
Raw evidence
- Runs behind this row
- Every matching trial for this model →