Run camp-code-depth-gemma4qat-002
PASSEDWhat this run revealed, then every individual trial as evidence.
33
Trials
100%
33/33 scored
over trials
Pass rate
0
Failures
$0.0073
Run cost
Run camp-code-depth-gemma4qat-002: passed essentially everything (100%) -- this test did not challenge the model.
Of 33 scored trials (code query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 36" | code_trace | - | 0.000195 | 258/565 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 105" | code_trace | - | 0.000212 | 225/633 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: -2" | code_trace | - | 0.000223 | 218/670 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [4, 0, 0, 2, 6, 0, 2, 17, 1]" | code_trace | - | 0.000253 | 275/753 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 43" | code_trace | - | 0.000196 | 223/578 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 56" | code_trace | - | 0.000177 | 239/509 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 72" | code_trace | - | 0.000197 | 222/583 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 13" | code_trace | - | 0.000235 | 206/713 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 2, 7, 2, 9, 9, 4, 76]" | code_trace | - | 0.000253 | 252/759 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 23" | code_trace | - | 0.000190 | 235/555 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: -22" | code_trace | - | 0.000201 | 210/600 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 7, 8, 7, 3, 3, 8, 19]" | code_trace | - | 0.000235 | 245/702 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 434" | code_trace | - | 0.000247 | 213/752 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 8" | code_trace | - | 0.000168 | 230/483 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 39" | code_trace | - | 0.000202 | 208/604 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 3, 6, 0, 22]" | code_trace | - | 0.000215 | 243/637 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 23" | code_trace | - | 0.000234 | 246/697 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 51" | code_trace | - | 0.000196 | 244/572 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 72" | code_trace | - | 0.000200 | 231/590 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 143" | code_trace | - | 0.000232 | 232/697 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 0, 1, 43, 4]" | code_trace | - | 0.000259 | 299/763 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 110" | code_trace | - | 0.000211 | 246/621 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [4, 7, 672, 18, 4]" | code_trace | - | 0.000217 | 239/644 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 94" | code_trace | - | 0.000221 | 247/656 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 29" | code_trace | - | 0.000225 | 236/672 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: -7" | code_trace | - | 0.000222 | 256/653 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [0, 8, 8, 4]" | code_trace | - | 0.000226 | 269/662 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 141" | code_trace | - | 0.000224 | 248/664 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 126" | code_trace | - | 0.000244 | 242/733 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 153" | code_trace | - | 0.000246 | 241/738 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 56" | code_trace | - | 0.000247 | 252/741 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 318" | code_trace | - | 0.000261 | 239/789 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: -1804" | code_trace | - | 0.000268 | 245/811 | full transcript → |