Run camp-code-gotcha-gemma4qat-002
PASSEDWhat this run revealed, then every individual trial as evidence.
33
Trials
100%
33/33 scored
over trials
Pass rate
0
Failures
$0.0081
Run cost
Run camp-code-gotcha-gemma4qat-002: passed essentially everything (100%) -- this test did not challenge the model.
Of 33 scored trials (code query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 2" | code_trace | - | 0.000170 | 246/483 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 3" | code_trace | - | 0.000182 | 244/525 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 14" | code_trace | - | 0.000184 | 217/541 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 2, 2, 6, 2, 2]" | code_trace | - | 0.000262 | 261/785 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [3, 9, 9, 2]" | code_trace | - | 0.000244 | 254/728 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 11" | code_trace | - | 0.000206 | 235/609 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 70" | code_trace | - | 0.000213 | 250/626 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [0, 9, 3, 1, -33, 8]" | code_trace | - | 0.000279 | 249/848 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [4, 9, 12, 3]" | code_trace | - | 0.000300 | 237/920 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 39" | code_trace | - | 0.000198 | 256/573 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 21" | code_trace | - | 0.000214 | 270/624 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 12" | code_trace | - | 0.000227 | 249/675 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 2583" | code_trace | - | 0.000263 | 282/782 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 8" | code_trace | - | 0.000173 | 236/498 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 81" | code_trace | - | 0.000212 | 249/623 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 34" | code_trace | - | 0.000235 | 252/700 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [3, 6, -2, 9, 3]" | code_trace | - | 0.000283 | 272/854 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 36" | code_trace | - | 0.000204 | 254/596 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 1" | code_trace | - | 0.000244 | 267/724 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 426" | code_trace | - | 0.000248 | 280/735 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 7, 1, 2, 2, 6, 6, 2, 2, 1, 2, 2, 6, 6, 2, 2, ..." | code_trace | - | 0.000372 | 403/1106 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 30" | code_trace | - | 0.000211 | 254/618 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 43" | code_trace | - | 0.000213 | 266/623 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [4, 4, 2, 5, 9, 3]" | code_trace | - | 0.000244 | 327/705 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 7, 3, 8, 2, 7, 6, 2, 33]" | code_trace | - | 0.000287 | 321/851 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000246 | 312/715 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 6, 9, 1, 1, 11, 12, 9, 2]" | code_trace | - | 0.000295 | 410/848 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [3, 8, 2, 2, 1, 1, 3, 3, 8, 2, 2]" | code_trace | - | 0.000305 | 406/882 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 2, 7, 4, 1, 6, 1, 2, 1, 1, 6, 13, 4]" | code_trace | - | 0.000338 | 443/978 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 27" | code_trace | - | 0.000218 | 304/627 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 55" | code_trace | - | 0.000275 | 316/812 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [4, 9, 2, 1, 1, 10, 8, 9, 2]" | code_trace | - | 0.000292 | 395/841 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 66" | code_trace | - | 0.000295 | 335/873 | full transcript → |