Run camp-code-stack-gemma4qat-002
PASSEDWhat this run revealed, then every individual trial as evidence.
33
Trials
100%
33/33 scored
over trials
Pass rate
0
Failures
$0.0091
Run cost
Run camp-code-stack-gemma4qat-002: passed essentially everything (100%) -- this test did not challenge the model.
Of 33 scored trials (code query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [7, 7, 9, 0, 0, 1, 1, 1, 7]" | code_trace | - | 0.000230 | 250/684 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 5, 2, 6, 4]" | code_trace | - | 0.000232 | 245/692 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 50" | code_trace | - | 0.000260 | 263/778 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 5, 8, 8, 0, 0, 8, 7]" | code_trace | - | 0.000312 | 247/959 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 0" | code_trace | - | 0.000238 | 249/712 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 40" | code_trace | - | 0.000212 | 257/620 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 7, 7, 7, 12, 14]" | code_trace | - | 0.000229 | 255/680 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 35" | code_trace | - | 0.000229 | 228/686 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 9, 3, 3, 8, 5, 9, 3, 3, 8, 1, 17]" | code_trace | - | 0.000265 | 269/795 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 37" | code_trace | - | 0.000196 | 234/576 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 27" | code_trace | - | 0.000211 | 228/628 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 3, 1, 2, 2, 3, 2, 9, 22]" | code_trace | - | 0.000256 | 260/766 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 0, 9, 7, 14, 3]" | code_trace | - | 0.000280 | 241/853 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 132" | code_trace | - | 0.000198 | 229/583 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 27" | code_trace | - | 0.000216 | 263/632 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 46" | code_trace | - | 0.000226 | 240/674 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 1, 18]" | code_trace | - | 0.000265 | 269/793 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 56" | code_trace | - | 0.000236 | 231/711 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 95" | code_trace | - | 0.000278 | 257/841 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 52" | code_trace | - | 0.000281 | 260/849 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [3, 0, 2, 4, 4, 2, 2, 2, 20, 18, 4, 3]" | code_trace | - | 0.000302 | 264/918 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 79" | code_trace | - | 0.000276 | 251/835 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 62" | code_trace | - | 0.000295 | 284/890 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 27" | code_trace | - | 0.000343 | 292/1045 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 9, 7, 7, 3, 3, 4, 4, 6, 6, 14, -4, 42, 7, 5]" | code_trace | - | 0.000395 | 311/1213 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 86" | code_trace | - | 0.000311 | 296/937 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 75" | code_trace | - | 0.000324 | 298/981 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 63" | code_trace | - | 0.000338 | 321/1021 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 0, 9, 6, 47, 21, 7, 3]" | code_trace | - | 0.000399 | 342/1217 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 95" | code_trace | - | 0.000282 | 293/843 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 71" | code_trace | - | 0.000288 | 294/861 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 69" | code_trace | - | 0.000377 | 311/1154 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [1, 6, 6, 4, 53, 12, 6, 1, 6]" | code_trace | - | 0.000352 | 310/1071 | full transcript → |