Run camp-code-dialect-gemma4qat-002
PASSEDWhat this run revealed, then every individual trial as evidence.
40
Trials
100%
40/40 scored
over trials
Pass rate
0
Failures
$0.0086
Run cost
Run camp-code-dialect-gemma4qat-002: passed essentially everything (100%) -- this test did not challenge the model.
Of 40 scored trials (code query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 3" | code_trace | - | 0.000106 | 101/320 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 45" | code_trace | - | 0.000112 | 134/330 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 10" | code_trace | - | 0.000119 | 149/348 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 7, 6, 6, 10, 2]" | code_trace | - | 0.000125 | 144/369 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [4, 6, 3, 4, -46, 4]" | code_trace | - | 0.000131 | 132/394 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 33" | code_trace | - | 0.000126 | 184/358 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 35" | code_trace | - | 0.000146 | 196/420 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 32" | code_trace | - | 0.000147 | 192/426 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 24" | code_trace | - | 0.000150 | 195/434 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [7, 8, 0, 1, 2, 3, 4, 5, 6, 1, 8]" | code_trace | - | 0.000197 | 197/592 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 22" | code_trace | - | 0.000143 | 192/414 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 42" | code_trace | - | 0.000153 | 198/443 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 23" | code_trace | - | 0.000164 | 205/478 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 33" | code_trace | - | 0.000185 | 190/552 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [3, 7, 9, 9, 0, 1, 2, 3, 4, 5, 27]" | code_trace | - | 0.000212 | 204/638 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 62" | code_trace | - | 0.000178 | 244/512 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 24" | code_trace | - | 0.000186 | 254/536 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 53" | code_trace | - | 0.000221 | 289/640 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 43" | code_trace | - | 0.000230 | 264/679 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 8, 2, 7, 1, 2, 3, 4, -2, 6, 34]" | code_trace | - | 0.000276 | 286/826 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 113" | code_trace | - | 0.000187 | 266/535 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 23" | code_trace | - | 0.000197 | 277/565 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 30" | code_trace | - | 0.000209 | 277/606 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 15" | code_trace | - | 0.000212 | 266/619 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 30" | code_trace | - | 0.000224 | 283/652 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 83" | code_trace | - | 0.000226 | 331/644 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 35" | code_trace | - | 0.000238 | 325/686 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 48" | code_trace | - | 0.000268 | 343/778 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 9, 3, 4, 5, 5, -2, 8, 5]" | code_trace | - | 0.000274 | 347/798 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [4, 2, 3, 3, 4, 5, -1]" | code_trace | - | 0.000281 | 370/813 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 34" | code_trace | - | 0.000266 | 392/757 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 66" | code_trace | - | 0.000298 | 415/854 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 47" | code_trace | - | 0.000303 | 434/866 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 584" | code_trace | - | 0.000303 | 419/869 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [3, 6, 6, 4, 0, 1, 2, 3, 4, 5, 6, -3, 7, 1, 8]" | code_trace | - | 0.000347 | 423/1015 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 72" | code_trace | - | 0.000268 | 409/756 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 41" | code_trace | - | 0.000269 | 401/764 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 34" | code_trace | - | 0.000285 | 397/819 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [4, 6, 4, 8, 3, 0, 1, 2, 3, 0, 8]" | code_trace | - | 0.000322 | 426/933 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [7, 0, 3, 0, 1, 2, 3, -2, 1, -8]" | code_trace | - | 0.000352 | 419/1034 | full transcript → |