Run camp-code-lookalike-gemma4qat-002
PASSEDWhat this run revealed, then every individual trial as evidence.
24
1 error
Trials
100%
23/23 scored
over trials
Pass rate
0
Failures
$0.0059
Run cost
Run camp-code-lookalike-gemma4qat-002: passed essentially everything (100%) -- this test did not challenge the model.
Of 23 scored trials (code query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
1 additional trial(s) ended in ERROR (infra failures, cost cap, or cancellation) and are excluded from the pass rate above.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 21" | code_trace | - | 0.000088 | 107/258 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 27" | code_trace | - | 0.000089 | 111/260 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 5, 8, 8, 5]" | code_trace | - | 0.000119 | 122/355 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 15" | code_trace | - | 0.000128 | 145/379 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 21" | code_trace | - | 0.000167 | 147/508 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕ERRORtimeout | code_trace | - | 0.000000 | 0/0 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 7" | code_trace | - | 0.000179 | 229/522 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 9, 5, 9]" | code_trace | - | 0.000195 | 234/571 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: -11" | code_trace | - | 0.000276 | 204/851 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 18" | code_trace | - | 0.000187 | 242/542 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 3" | code_trace | - | 0.000234 | 257/695 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 3, 4, 4, 3, 3]" | code_trace | - | 0.000259 | 258/779 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 31" | code_trace | - | 0.000208 | 258/607 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 134" | code_trace | - | 0.000266 | 316/782 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 42" | code_trace | - | 0.000266 | 279/792 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 15" | code_trace | - | 0.000270 | 341/786 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 41" | code_trace | - | 0.000352 | 328/1063 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 6, 7, 9, 12]" | code_trace | - | 0.000370 | 396/1100 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 32" | code_trace | - | 0.000287 | 393/826 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [1, 8, 3, 3, 1, 3, 2, 8, 3]" | code_trace | - | 0.000397 | 460/1169 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 7, 5, 8, 0, 0, 1]" | code_trace | - | 0.000421 | 437/1259 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [3, 5, 2, 18, 3, 8]" | code_trace | - | 0.000358 | 401/1060 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 17" | code_trace | - | 0.000371 | 469/1079 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [3, 0, 4, 16, 5, 31]" | code_trace | - | 0.000423 | 433/1266 | full transcript → |