Run camp-code-length-gemma4qat-002
PASSEDWhat this run revealed, then every individual trial as evidence.
24
1 error
Trials
100%
23/23 scored
over trials
Pass rate
0
Failures
$0.0067
Run cost
Run camp-code-length-gemma4qat-002: passed essentially everything (100%) -- this test did not challenge the model.
Of 23 scored trials (code query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
1 additional trial(s) ended in ERROR (infra failures, cost cap, or cancellation) and are excluded from the pass rate above.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 13" | code_trace | - | 0.000093 | 101/277 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [1, 0, 4, 6]" | code_trace | - | 0.000102 | 106/306 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [7, 9, 2, 4]" | code_trace | - | 0.000102 | 123/300 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000154 | 168/459 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 12" | code_trace | - | 0.000170 | 179/507 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕ERRORtimeout | code_trace | - | 0.000000 | 0/0 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 7" | code_trace | - | 0.000165 | 232/473 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 5, 2]" | code_trace | - | 0.000208 | 257/606 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 64" | code_trace | - | 0.000237 | 226/716 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 8" | code_trace | - | 0.000206 | 296/587 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 15" | code_trace | - | 0.000219 | 290/633 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 13" | code_trace | - | 0.000245 | 289/721 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 4" | code_trace | - | 0.000258 | 397/728 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 5" | code_trace | - | 0.000267 | 344/774 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [3, 4, 1, 2, 3, 4]" | code_trace | - | 0.000409 | 404/1229 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 30" | code_trace | - | 0.000276 | 436/776 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 12" | code_trace | - | 0.000421 | 418/1263 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 9" | code_trace | - | 0.000479 | 454/1445 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 2" | code_trace | - | 0.000379 | 511/1094 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 8" | code_trace | - | 0.000500 | 477/1508 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 4, 6, 0, 3, 3, 3, 3, 1, 1, 3, 3, 7, 7, 4, 9]" | code_trace | - | 0.000522 | 539/1561 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 28" | code_trace | - | 0.000300 | 620/792 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 62" | code_trace | - | 0.000429 | 573/1240 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 8, 6, 5, 3]" | code_trace | - | 0.000554 | 596/1649 | full transcript → |