Run camp-code-dialect-gemma4qat-001
PASSEDWhat this run revealed, then every individual trial as evidence.
24
1 error
Trials
100%
23/23 scored
over trials
Pass rate
0
Failures
$0.0052
Run cost
Run camp-code-dialect-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.
Of 23 scored trials (code query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
1 additional trial(s) ended in ERROR (infra failures, cost cap, or cancellation) and are excluded from the pass rate above.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 3" | code_trace | - | 0.000106 | 101/320 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 7, 6, 6, 10, 2]" | code_trace | - | 0.000125 | 144/369 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 10" | code_trace | - | 0.000123 | 149/362 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 44" | code_trace | - | 0.000138 | 179/400 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 32" | code_trace | - | 0.000147 | 192/426 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕ERRORtimeout | code_trace | - | 0.000000 | 0/0 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 29" | code_trace | - | 0.000160 | 193/470 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 48" | code_trace | - | 0.000168 | 197/494 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 31" | code_trace | - | 0.000179 | 206/527 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 33" | code_trace | - | 0.000175 | 259/497 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 23" | code_trace | - | 0.000181 | 272/512 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 8, 9, 0, 0, 1, 2, 3, -4, 0]" | code_trace | - | 0.000234 | 288/683 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 49" | code_trace | - | 0.000199 | 278/570 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000207 | 259/603 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [3, 8, 4, 2, 8, 0, 1, 2, 3, 0]" | code_trace | - | 0.000304 | 287/917 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 17" | code_trace | - | 0.000236 | 346/672 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 40" | code_trace | - | 0.000250 | 332/723 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 77" | code_trace | - | 0.000274 | 339/801 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [0, 8, 9, 5, 0, 1, 2, 3, -1, 8]" | code_trace | - | 0.000312 | 389/909 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 48" | code_trace | - | 0.000316 | 402/921 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 5, 4, 0, 1, 2, 3, 4, -1, 3, 1, 114, 3]" | code_trace | - | 0.000421 | 436/1259 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 25" | code_trace | - | 0.000264 | 400/747 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 43" | code_trace | - | 0.000282 | 408/805 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [3, 5, 3, 3, 1, 1, 5, 5, 0, 1, 2, 3, -3, 3, 1, 5,..." | code_trace | - | 0.000389 | 442/1151 | full transcript → |