Run camp-code-traps-gemma4qat-001
PASSEDWhat this run revealed, then every individual trial as evidence.
56
Trials
100%
56/56 scored
over trials
Pass rate
0
Failures
$0.0122
Run cost
Run camp-code-traps-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.
Of 56 scored trials (code query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 9" | code_trace | - | 0.000085 | 103/250 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 9" | code_trace | - | 0.000092 | 112/270 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 16" | code_trace | - | 0.000102 | 115/303 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 9, 0, 2]" | code_trace | - | 0.000108 | 110/322 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [0, 3, 2, 8, 4, 3]" | code_trace | - | 0.000118 | 144/345 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [0, 4, 0, 9, 4, 4]" | code_trace | - | 0.000121 | 125/360 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 0, 5, 0]" | code_trace | - | 0.000111 | 110/333 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 17" | code_trace | - | 0.000101 | 122/295 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 8" | code_trace | - | 0.000114 | 135/334 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 47" | code_trace | - | 0.000128 | 142/381 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 49" | code_trace | - | 0.000133 | 161/389 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [3, 6, 15, 8]" | code_trace | - | 0.000143 | 140/429 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 29" | code_trace | - | 0.000153 | 135/465 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 28" | code_trace | - | 0.000122 | 149/356 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 12" | code_trace | - | 0.000106 | 160/299 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 8" | code_trace | - | 0.000110 | 171/308 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 5" | code_trace | - | 0.000146 | 167/431 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 39" | code_trace | - | 0.000151 | 160/449 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [3, 4, 2, 2]" | code_trace | - | 0.000153 | 163/457 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 2, 8, 12, 9]" | code_trace | - | 0.000169 | 174/505 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 8" | code_trace | - | 0.000124 | 152/364 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 4" | code_trace | - | 0.000144 | 184/419 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 10" | code_trace | - | 0.000155 | 200/450 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 15" | code_trace | - | 0.000174 | 203/512 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [7, 3, 9, 3]" | code_trace | - | 0.000174 | 195/515 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 9" | code_trace | - | 0.000188 | 184/564 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 25" | code_trace | - | 0.000227 | 217/685 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 17" | code_trace | - | 0.000187 | 203/557 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 100" | code_trace | - | 0.000245 | 292/720 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 72" | code_trace | - | 0.000261 | 298/770 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 113" | code_trace | - | 0.000274 | 299/813 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 99" | code_trace | - | 0.000280 | 316/827 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 8, 1, 1, 18, 16, 23, 0, 1, 2, 3, 4, 2, 3, 7, 3]" | code_trace | - | 0.000310 | 295/936 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 7, 0, 2, 4, 32, 10, 0, 1, 2, 3, 4, 5, -1, 7, ..." | code_trace | - | 0.000342 | 317/1033 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 1, 3, 3, 2, 2, 4, 4, 5, 5, 13, 8, 27, 0, 1, 2..." | code_trace | - | 0.000396 | 314/1216 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 90" | code_trace | - | 0.000260 | 318/760 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 112" | code_trace | - | 0.000280 | 319/827 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 59" | code_trace | - | 0.000281 | 319/831 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 109" | code_trace | - | 0.000296 | 309/884 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 64" | code_trace | - | 0.000253 | 302/742 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 9, 17, 3, 16, 14, 3, 4, 5, -2, 2, 0]" | code_trace | - | 0.000330 | 317/995 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [4, 2, 3, 19, 30, 20, 0, 1, 2, 3, -2, 2, 4]" | code_trace | - | 0.000338 | 354/1010 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 76" | code_trace | - | 0.000261 | 309/766 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 132" | code_trace | - | 0.000280 | 296/835 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 112" | code_trace | - | 0.000288 | 311/857 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 86" | code_trace | - | 0.000293 | 327/867 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 4, 12, 7, 3, 11, 26, 0, 1, 2, 3, 4, 5, 2, 3]" | code_trace | - | 0.000324 | 320/974 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 124" | code_trace | - | 0.000282 | 298/839 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [1, 5, 14, 10, 12, 0, 1, 2, 3, 4, 2, 3, 4, 0]" | code_trace | - | 0.000343 | 321/1037 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 68" | code_trace | - | 0.000257 | 300/757 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 57" | code_trace | - | 0.000268 | 316/789 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 121" | code_trace | - | 0.000277 | 285/830 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 263" | code_trace | - | 0.000288 | 283/867 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 3, 5, 1, 5, 19, 22, 14, 2, 3, 4, -2, 9, 4]" | code_trace | - | 0.000350 | 324/1060 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 59" | code_trace | - | 0.000289 | 309/861 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 4, 17, 5, 5, 2, 2, 2, 2, 25, 29, 0, 1, 2, 3, ..." | code_trace | - | 0.000422 | 334/1294 | full transcript → |