Run smoke-code-r2-gemma4qat
PASSEDWhat this run revealed, then every individual trial as evidence.
3
Trials
100%
3/3 scored
Pass rate
0
Failures
$0.0009
Run cost
Run smoke-code-r2-gemma4qat: passed essentially everything (100%) -- this test did not challenge the model.
Of 3 scored trials (code query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [1, 7, 3, -843, 2, 4]" | code_trace | - | 0.000263 | 261/791 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 4, 8, 4, 52, 21, 22, 5, 2]" | code_trace | - | 0.000386 | 311/1182 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 23" | code_trace | - | 0.000222 | 300/641 | full transcript → |