Run camp-code-traps-gemma4qat-002
PASSEDWhat this run revealed, then every individual trial as evidence.
24
Trials
100%
24/24 scored
over trials
Pass rate
0
Failures
$0.0052
Run cost
Run camp-code-traps-gemma4qat-002: passed essentially everything (100%) -- this test did not challenge the model.
Of 24 scored trials (code query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 9" | code_trace | - | 0.000085 | 103/250 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 16" | code_trace | - | 0.000102 | 115/303 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [0, 4, 0, 9, 4, 4]" | code_trace | - | 0.000121 | 125/360 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 17" | code_trace | - | 0.000133 | 162/390 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [4, 5, 3, 3]" | code_trace | - | 0.000132 | 144/391 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 33" | code_trace | - | 0.000139 | 147/415 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 29" | code_trace | - | 0.000118 | 177/334 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 16" | code_trace | - | 0.000128 | 163/373 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 20" | code_trace | - | 0.000137 | 171/400 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 7" | code_trace | - | 0.000119 | 187/335 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 12" | code_trace | - | 0.000144 | 197/414 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 7, 4, 1]" | code_trace | - | 0.000172 | 226/498 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 105" | code_trace | - | 0.000263 | 286/783 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 95" | code_trace | - | 0.000279 | 292/833 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [3, 4, 15, 16, 14, 2, 3, 2, 6, 3, 2]" | code_trace | - | 0.000342 | 333/1028 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 132" | code_trace | - | 0.000274 | 298/815 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 58" | code_trace | - | 0.000275 | 298/819 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [17, 2, 3, 4, 13, 8, 0, 1, 2, -3, 2, 3, 0]" | code_trace | - | 0.000348 | 347/1045 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 94" | code_trace | - | 0.000263 | 320/769 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 67" | code_trace | - | 0.000263 | 316/770 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 0, 3, 12, 30, 29, 0, 1, 2, 3, 4, 5, -2, 2, 3, 6]" | code_trace | - | 0.000344 | 324/1038 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 84" | code_trace | - | 0.000285 | 319/844 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [17, 3, 6, 6, 20, 16, 0, 1, 2, 4, 3]" | code_trace | - | 0.000349 | 348/1046 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [13, 6, 8, 6, 6, 8, 8, 8, 24, 0, 1, 2, 4, 3, 6, 8]" | code_trace | - | 0.000360 | 351/1082 | full transcript → |