Run camp-code-depth-gemma4qat-001
PASSEDWhat this run revealed, then every individual trial as evidence.
33
Trials
100%
33/33 scored
over trials
Pass rate
0
Failures
$0.0073
Run cost
Run camp-code-depth-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.
Of 33 scored trials (code query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: -2" | code_trace | - | 0.000180 | 261/512 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 62" | code_trace | - | 0.000195 | 233/571 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 137" | code_trace | - | 0.000209 | 233/618 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [3, 5, 8, 4, 14, 42, -7]" | code_trace | - | 0.000242 | 238/726 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 65" | code_trace | - | 0.000177 | 238/509 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 4, 1, 14, 77]" | code_trace | - | 0.000207 | 249/607 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 82" | code_trace | - | 0.000207 | 237/610 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 5" | code_trace | - | 0.000234 | 224/707 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [7, 6, 1, 10, 4, -80]" | code_trace | - | 0.000250 | 229/757 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 31" | code_trace | - | 0.000201 | 226/594 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: -7" | code_trace | - | 0.000205 | 220/609 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [3, 0, 3, -88, -14]" | code_trace | - | 0.000214 | 231/637 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 64" | code_trace | - | 0.000233 | 226/702 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 4, 9, 3, 2]" | code_trace | - | 0.000214 | 218/640 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 399" | code_trace | - | 0.000230 | 221/694 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 8, 3, 3, 10, 105, 4]" | code_trace | - | 0.000240 | 253/714 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 113" | code_trace | - | 0.000240 | 220/726 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: -9" | code_trace | - | 0.000190 | 226/558 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 8" | code_trace | - | 0.000206 | 227/610 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 56" | code_trace | - | 0.000220 | 226/658 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 545" | code_trace | - | 0.000257 | 226/783 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: -27" | code_trace | - | 0.000191 | 207/568 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 7, 2, 3, -1]" | code_trace | - | 0.000197 | 222/583 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: -169" | code_trace | - | 0.000228 | 226/685 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 110" | code_trace | - | 0.000260 | 222/792 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 42" | code_trace | - | 0.000206 | 236/609 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 132" | code_trace | - | 0.000215 | 223/643 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: -31" | code_trace | - | 0.000224 | 230/671 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [0, 2, 5, 7, 308, 14, 3]" | code_trace | - | 0.000277 | 282/830 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 95" | code_trace | - | 0.000232 | 259/688 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 406" | code_trace | - | 0.000242 | 248/723 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 9, 38, 2, 4]" | code_trace | - | 0.000242 | 247/724 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: -5516" | code_trace | - | 0.000263 | 279/783 | full transcript → |