Run camp-ef-comments-gemma4qat-001
PASSEDWhat this run revealed, then every individual trial as evidence.
40
Trials
100%
40/40 scored
over trials
Pass rate
0
Failures
$0.0062
Run cost
Run camp-ef-comments-gemma4qat-001: every arm passes cleanly.
Arm A passes cleanly (100%, 10 trials).
Arm B passes cleanly (100%, 10 trials).
Arm D passes cleanly (100%, 10 trials).
Arm E passes cleanly (100%, 10 trials).
Trials
Per-trial table
| model | stage | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | A | ✓PASSanswered "ANSWER: [9, 2, 7, 24, 2]" | code_trace | - | 0.000143 | 190/413 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | A | ✓PASSanswered "ANSWER: [2, 2, 6]" | code_trace | - | 0.000150 | 167/443 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | A | ✓PASSanswered "ANSWER: 11" | code_trace | - | 0.000181 | 203/537 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | A | ✓PASSanswered "ANSWER: 12" | code_trace | - | 0.000115 | 151/333 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | A | ✓PASSanswered "ANSWER: 9" | code_trace | - | 0.000151 | 161/451 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | A | ✓PASSanswered "ANSWER: [6, 0, 1, 1, 9, 9, 7, 7, 1, 9, 7, 3, 2]" | code_trace | - | 0.000197 | 182/595 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | A | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000145 | 173/427 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | A | ✓PASSanswered "ANSWER: 20" | code_trace | - | 0.000119 | 166/343 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | A | ✓PASSanswered "ANSWER: 8" | code_trace | - | 0.000141 | 167/415 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | A | ✓PASSanswered "ANSWER: [8, 5, 78, 2]" | code_trace | - | 0.000186 | 187/558 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | B | ✓PASSanswered "ANSWER: [9, 2, 7, 24, 2]" | code_trace | - | 0.000159 | 217/459 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | B | ✓PASSanswered "ANSWER: [2, 2, 6]" | code_trace | - | 0.000169 | 187/502 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | B | ✓PASSanswered "ANSWER: 11" | code_trace | - | 0.000169 | 208/493 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | B | ✓PASSanswered "ANSWER: 12" | code_trace | - | 0.000123 | 157/358 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | B | ✓PASSanswered "ANSWER: 9" | code_trace | - | 0.000138 | 167/404 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | B | ✓PASSanswered "ANSWER: [6, 0, 1, 1, 9, 9, 7, 7, 1, 9, 7, 3, 2]" | code_trace | - | 0.000220 | 218/661 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | B | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000143 | 188/414 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | B | ✓PASSanswered "ANSWER: 20" | code_trace | - | 0.000127 | 173/366 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | B | ✓PASSanswered "ANSWER: 8" | code_trace | - | 0.000134 | 179/386 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | B | ✓PASSanswered "ANSWER: [8, 5, 78, 2]" | code_trace | - | 0.000187 | 202/555 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | D | ✓PASSanswered "ANSWER: [9, 2, 7, 24, 2]" | code_trace | - | 0.000151 | 219/432 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | D | ✓PASSanswered "ANSWER: [2, 2, 6]" | code_trace | - | 0.000158 | 189/465 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | D | ✓PASSanswered "ANSWER: 11" | code_trace | - | 0.000165 | 210/481 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | D | ✓PASSanswered "ANSWER: 12" | code_trace | - | 0.000125 | 159/364 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | D | ✓PASSanswered "ANSWER: 9" | code_trace | - | 0.000150 | 169/445 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | D | ✓PASSanswered "ANSWER: [6, 0, 1, 1, 9, 9, 7, 7, 1, 9, 7, 3, 2]" | code_trace | - | 0.000218 | 220/652 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | D | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000143 | 190/414 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | D | ✓PASSanswered "ANSWER: 20" | code_trace | - | 0.000114 | 175/323 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | D | ✓PASSanswered "ANSWER: 8" | code_trace | - | 0.000137 | 181/396 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | D | ✓PASSanswered "ANSWER: [8, 5, 78, 2]" | code_trace | - | 0.000171 | 204/502 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | E | ✓PASSanswered "ANSWER: [9, 2, 7, 24, 2]" | code_trace | - | 0.000161 | 219/465 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | E | ✓PASSanswered "ANSWER: [2, 2, 6]" | code_trace | - | 0.000166 | 188/490 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | E | ✓PASSanswered "ANSWER: 11" | code_trace | - | 0.000173 | 210/508 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | E | ✓PASSanswered "ANSWER: 12" | code_trace | - | 0.000131 | 157/385 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | E | ✓PASSanswered "ANSWER: 9" | code_trace | - | 0.000166 | 168/497 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | E | ✓PASSanswered "ANSWER: [6, 0, 1, 1, 9, 9, 7, 7, 1, 9, 7, 3, 2]" | code_trace | - | 0.000209 | 220/625 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | E | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000149 | 189/435 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | E | ✓PASSanswered "ANSWER: 20" | code_trace | - | 0.000127 | 174/365 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | E | ✓PASSanswered "ANSWER: 8" | code_trace | - | 0.000133 | 180/384 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | E | ✓PASSanswered "ANSWER: [8, 5, 78, 2]" | code_trace | - | 0.000186 | 204/552 | full transcript → |