Run camp-code-gotcha-gemma4qat-001
PASSEDWhat this run revealed, then every individual trial as evidence.
33
Trials
100%
33/33 scored
over trials
Pass rate
0
Failures
$0.0077
Run cost
Run camp-code-gotcha-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.
Of 33 scored trials (code query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [0, 4, 6, 1, 1]" | code_trace | - | 0.000209 | 244/616 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [7, 1, 0, 0, 14, 9]" | code_trace | - | 0.000219 | 232/654 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 17" | code_trace | - | 0.000225 | 226/673 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [7, 7, 2, 7, 6, 6]" | code_trace | - | 0.000228 | 258/675 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 20" | code_trace | - | 0.000183 | 224/536 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 17" | code_trace | - | 0.000194 | 217/573 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 15" | code_trace | - | 0.000196 | 234/575 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [7, 3, 7, 2, 3, 1, 1]" | code_trace | - | 0.000209 | 245/615 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 6, 30, 15, 5]" | code_trace | - | 0.000216 | 250/637 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 18" | code_trace | - | 0.000197 | 242/575 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 26" | code_trace | - | 0.000205 | 265/596 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 25" | code_trace | - | 0.000220 | 250/651 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 1, 5, 3, 12, 5, 8]" | code_trace | - | 0.000229 | 288/669 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 22" | code_trace | - | 0.000186 | 259/532 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 25" | code_trace | - | 0.000209 | 259/609 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 27" | code_trace | - | 0.000212 | 242/627 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 16" | code_trace | - | 0.000221 | 259/650 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 42" | code_trace | - | 0.000242 | 273/717 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [4, 0, 0, 0, 3, 8, 3, 11, 8]" | code_trace | - | 0.000269 | 360/776 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 4, 2, 1, 6, 11, 8, 2]" | code_trace | - | 0.000269 | 336/785 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 0, 1, 15, 1, 8, 7, 90]" | code_trace | - | 0.000266 | 310/784 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000200 | 268/576 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 59" | code_trace | - | 0.000258 | 272/769 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 406" | code_trace | - | 0.000272 | 285/813 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [0, 7, 14, 7, 5, 12, 5]" | code_trace | - | 0.000292 | 331/864 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 43" | code_trace | - | 0.000230 | 297/668 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [0, 4, 3, 2, 2, 10, 5, 9, 2]" | code_trace | - | 0.000294 | 394/848 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 6, 3, 1, 12, 7, 10, 2]" | code_trace | - | 0.000310 | 402/899 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [3, 8, 1, 1, 9, 4, 8, 5]" | code_trace | - | 0.000311 | 370/912 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 36" | code_trace | - | 0.000200 | 306/565 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 33" | code_trace | - | 0.000231 | 295/672 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 38" | code_trace | - | 0.000249 | 324/721 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 1, 1, 3, 9, 6, 7, 1]" | code_trace | - | 0.000288 | 358/840 | full transcript → |