IV · Code tracing
Traces a program through semantic traps (aliasing, closures, off-by-one, modulo, defaults)
Gemma 4 31B QAT
Finding:HOLDS· grade A(research conclusion)
Holds through 6 of 6 traps active: 80/80 pass across every tested level
Held through 6 of 6 traps active
Pass rate by level
Dashed lines: a level at or below 30% pass counts toward BREAKS, at or below 75% toward DEGRADES. Labels above points: passed/scored.
| Level | Passed | Pass rate | Note |
|---|---|---|---|
| 0 of 6 traps active | 40/40 | 100% | |
| 6 of 6 traps active | 40/40 | 100% |
What the few failures have in common
No failures recorded in the trials behind this row.
Evidence
- Ground truthDeterministic simulation: the right answer is computed, not judged
- StatisticsWilson 95% interval 95%–100%
- Sample size80 scored trials in total
- Fresh-seed confirmationNot run yet
- ReplicationNot run yet
Raw evidence