Data to …… trials
EF · Evidence fidelity

Copies a carried opaque value instead of inventing one (paired, B arm, protocol v3)

Gemma 4 31B QAT

Finding:HOLDS· grade C(research conclusion)

100% correct (10/10)

Pass ratesingle rate, no difficulty dial
100%

10/10 scored trials passed · 95% interval 72%–100%

breaks ≤ 30%holds if interval reaches 95%0%50%100%
What the few failures have in common

No failures recorded in the trials behind this row.

Evidencewhat this finding rests on
  • Ground truthDeterministic simulation: the right answer is computed, not judged
  • StatisticsWilson 95% interval 72%–100%Grade C: thin evidence
  • Sample size10 scored trials in total: small sample (under 15)
  • Fresh-seed confirmationNot run yet
  • ReplicationNot run yet
Raw evidenceruns and trials

Back to the capability map →