Run camp-code-hunt-gemma4qat-001
PASSEDWhat this run revealed, then every individual trial as evidence.
183
Trials
100%
183/183 scored
over trials
Pass rate
0
Failures
$0.0433
Run cost
Run camp-code-hunt-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.
Of 183 scored trials (code query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 9, 9, 3, 6, 'tkt-ae3dc7:v2']" | code_trace | - | 0.000182 | 211/538 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 3, 7, 5, 2, 21]" | code_trace | - | 0.000247 | 254/740 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 74" | code_trace | - | 0.000275 | 303/815 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 3, 7, 1, 4, 6, 0, 1, 2, 3, -1]" | code_trace | - | 0.000283 | 294/846 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 2" | code_trace | - | 0.000273 | 305/808 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 2, 0, 0, 16, 8, 4, 8, 3]" | code_trace | - | 0.000228 | 257/674 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 38" | code_trace | - | 0.000199 | 226/589 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 8, 7, 0, 1, 2, 3, 3, 3, 34]" | code_trace | - | 0.000222 | 188/678 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000219 | 236/651 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: -111" | code_trace | - | 0.000228 | 234/681 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 83" | code_trace | - | 0.000275 | 213/845 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 89" | code_trace | - | 0.000295 | 302/882 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [4, 1, 4, 0, 'tkt-b6107c#done']" | code_trace | - | 0.000182 | 230/531 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 5, 4, 2]" | code_trace | - | 0.000222 | 273/649 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [1, 9, 4, 2, 7, 3, 0, 1, 2, 3, 4, 0]" | code_trace | - | 0.000270 | 307/799 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 10" | code_trace | - | 0.000238 | 307/690 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 65" | code_trace | - | 0.000207 | 233/612 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000214 | 176/654 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 60" | code_trace | - | 0.000192 | 203/574 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 9, 2, 1, 2, 5, 19, 8]" | code_trace | - | 0.000278 | 226/850 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 8" | code_trace | - | 0.000232 | 232/696 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 43" | code_trace | - | 0.000245 | 252/733 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 53" | code_trace | - | 0.000273 | 281/818 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 7, 2, 8, 1, 2, 3, 0, 1]" | code_trace | - | 0.000251 | 337/726 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [4, 9, 0, 'tkt-45d4a7:v2', 1, 8]" | code_trace | - | 0.000190 | 227/559 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 8, 5, 10, 0, -26, 9]" | code_trace | - | 0.000251 | 202/770 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 9" | code_trace | - | 0.000175 | 187/522 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 6, 9, 4]" | code_trace | - | 0.000355 | 291/1086 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 5, 10, 12, 4, 6, 3]" | code_trace | - | 0.000241 | 250/721 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 87" | code_trace | - | 0.000213 | 215/639 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 38" | code_trace | - | 0.000222 | 218/667 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [7, 0, 2, 9, 5, 10, 5, 2, 7]" | code_trace | - | 0.000237 | 249/706 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: -1089" | code_trace | - | 0.000276 | 253/834 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 23" | code_trace | - | 0.000202 | 292/575 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [13, 9, 5, 7, 17, 52, 1, 2, 3, 4, 3, 8, 50, 36]" | code_trace | - | 0.000387 | 314/1187 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 26" | code_trace | - | 0.000198 | 248/577 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 3, 5, 1, 'tkt-375775#done']" | code_trace | - | 0.000194 | 221/574 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 67" | code_trace | - | 0.000194 | 214/574 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 47" | code_trace | - | 0.000185 | 168/561 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 89" | code_trace | - | 0.000255 | 302/751 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 74" | code_trace | - | 0.000249 | 303/730 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 74" | code_trace | - | 0.000275 | 303/815 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 74" | code_trace | - | 0.000280 | 307/830 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 74" | code_trace | - | 0.000291 | 315/865 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 3, 7, 1, 4, 6, 0, 1, 2, 3, -1]" | code_trace | - | 0.000295 | 293/884 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 3, 7, 1, 4, 6, 0, 1, 2, 3, -1]" | code_trace | - | 0.000279 | 309/827 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 3, 7, 1, 4, 6, 0, 1, 2, 3, -1]" | code_trace | - | 0.000289 | 298/865 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 3, 7, 1, 4, 6, 0, 1, 2, 3, -1]" | code_trace | - | 0.000283 | 296/844 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 9, 9, 3, 6, 'tkt-ae3dc7:v2']" | code_trace | - | 0.000182 | 210/537 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 3, 7, 5, 2, 21]" | code_trace | - | 0.000244 | 258/727 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 3, 7, 5, 2, 21]" | code_trace | - | 0.000256 | 254/769 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 3, 7, 5, 2, 21]" | code_trace | - | 0.000261 | 253/787 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 9, 9, 3, 6, 'tkt-ae3dc7:v2']" | code_trace | - | 0.000187 | 215/550 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 9, 9, 3, 6, 'tkt-ae3dc7:v2']" | code_trace | - | 0.000179 | 211/526 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 2" | code_trace | - | 0.000271 | 305/803 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 2" | code_trace | - | 0.000263 | 306/775 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 2" | code_trace | - | 0.000260 | 309/763 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 2" | code_trace | - | 0.000249 | 305/730 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 2, 0, 0, 16, 8, 4, 8, 3]" | code_trace | - | 0.000228 | 257/674 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 2, 0, 0, 16, 8, 4, 8, 3]" | code_trace | - | 0.000249 | 259/744 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 2, 0, 0, 16, 8, 4, 8, 3]" | code_trace | - | 0.000232 | 264/685 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 8, 7, 0, 1, 2, 3, 3, 3, 34]" | code_trace | - | 0.000221 | 187/673 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 8, 7, 0, 1, 2, 3, 3, 3, 34]" | code_trace | - | 0.000237 | 203/721 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 8, 7, 0, 1, 2, 3, 3, 3, 34]" | code_trace | - | 0.000222 | 192/677 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 8, 7, 0, 1, 2, 3, 3, 3, 34]" | code_trace | - | 0.000194 | 186/585 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 38" | code_trace | - | 0.000201 | 226/596 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 38" | code_trace | - | 0.000199 | 230/587 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 38" | code_trace | - | 0.000190 | 226/559 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 83" | code_trace | - | 0.000235 | 213/712 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 83" | code_trace | - | 0.000241 | 217/732 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: -111" | code_trace | - | 0.000212 | 234/629 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 83" | code_trace | - | 0.000257 | 217/785 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: -111" | code_trace | - | 0.000212 | 235/629 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: -111" | code_trace | - | 0.000222 | 238/660 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: -111" | code_trace | - | 0.000228 | 234/681 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000213 | 236/633 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000218 | 240/647 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000220 | 236/653 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 89" | code_trace | - | 0.000294 | 302/881 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 89" | code_trace | - | 0.000302 | 317/900 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 89" | code_trace | - | 0.000283 | 307/840 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 89" | code_trace | - | 0.000283 | 298/843 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [1, 9, 4, 2, 7, 3, 0, 1, 2, 3, 4, 0]" | code_trace | - | 0.000260 | 307/763 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [1, 9, 4, 2, 7, 3, 0, 1, 2, 3, 4, 0]" | code_trace | - | 0.000258 | 308/759 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [1, 9, 4, 2, 7, 3, 0, 1, 2, 3, 4, 0]" | code_trace | - | 0.000285 | 322/842 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [1, 9, 4, 2, 7, 3, 0, 1, 2, 3, 4, 0]" | code_trace | - | 0.000256 | 311/751 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 5, 4, 2]" | code_trace | - | 0.000222 | 273/649 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [1, 9, 4, 2, 7, 3, 0, 1, 2, 3, 4, 0]" | code_trace | - | 0.000279 | 305/830 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 5, 4, 2]" | code_trace | - | 0.000218 | 274/635 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 5, 4, 2]" | code_trace | - | 0.000225 | 278/657 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 5, 4, 2]" | code_trace | - | 0.000214 | 258/628 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [4, 1, 4, 0, 'tkt-b6107c#done']" | code_trace | - | 0.000183 | 230/534 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [4, 1, 4, 0, 'tkt-b6107c#done']" | code_trace | - | 0.000191 | 234/559 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [4, 1, 4, 0, 'tkt-b6107c#done']" | code_trace | - | 0.000189 | 230/554 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 10" | code_trace | - | 0.000244 | 308/710 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 10" | code_trace | - | 0.000259 | 307/761 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 10" | code_trace | - | 0.000235 | 311/679 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 10" | code_trace | - | 0.000232 | 316/667 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 65" | code_trace | - | 0.000202 | 233/597 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 65" | code_trace | - | 0.000206 | 240/606 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 65" | code_trace | - | 0.000207 | 251/605 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000207 | 176/631 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000215 | 177/659 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000216 | 191/655 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000201 | 180/611 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000199 | 176/603 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 60" | code_trace | - | 0.000192 | 203/574 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 60" | code_trace | - | 0.000194 | 207/578 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 60" | code_trace | - | 0.000185 | 203/548 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 9, 2, 1, 2, 5, 19, 8]" | code_trace | - | 0.000278 | 226/850 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 8" | code_trace | - | 0.000232 | 232/696 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 9, 2, 1, 2, 5, 19, 8]" | code_trace | - | 0.000266 | 230/810 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 9, 2, 1, 2, 5, 19, 8]" | code_trace | - | 0.000268 | 226/819 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 8" | code_trace | - | 0.000237 | 236/712 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 8" | code_trace | - | 0.000233 | 232/698 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 43" | code_trace | - | 0.000235 | 252/699 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 43" | code_trace | - | 0.000242 | 256/723 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 43" | code_trace | - | 0.000231 | 257/683 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 53" | code_trace | - | 0.000253 | 281/749 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 53" | code_trace | - | 0.000253 | 285/747 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 53" | code_trace | - | 0.000274 | 293/815 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 53" | code_trace | - | 0.000249 | 282/736 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 7, 2, 8, 1, 2, 3, 0, 1]" | code_trace | - | 0.000250 | 336/720 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 7, 2, 8, 1, 2, 3, 0, 1]" | code_trace | - | 0.000253 | 338/730 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 7, 2, 8, 1, 2, 3, 0, 1]" | code_trace | - | 0.000260 | 349/750 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 7, 2, 8, 1, 2, 3, 0, 1]" | code_trace | - | 0.000249 | 341/715 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 7, 2, 8, 1, 2, 3, 0, 1]" | code_trace | - | 0.000230 | 337/654 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 8, 5, 10, 0, -26, 9]" | code_trace | - | 0.000238 | 202/727 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 8, 5, 10, 0, -26, 9]" | code_trace | - | 0.000237 | 207/722 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 8, 5, 10, 0, -26, 9]" | code_trace | - | 0.000234 | 198/713 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [4, 9, 0, 'tkt-45d4a7:v2', 1, 8]" | code_trace | - | 0.000204 | 227/605 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [4, 9, 0, 'tkt-45d4a7:v2', 1, 8]" | code_trace | - | 0.000194 | 231/569 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [4, 9, 0, 'tkt-45d4a7:v2', 1, 8]" | code_trace | - | 0.000204 | 225/605 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 6, 9, 4]" | code_trace | - | 0.000325 | 291/988 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 5, 10, 12, 4, 6, 3]" | code_trace | - | 0.000244 | 250/731 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 6, 9, 4]" | code_trace | - | 0.000311 | 295/940 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 6, 9, 4]" | code_trace | - | 0.000286 | 291/855 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 5, 10, 12, 4, 6, 3]" | code_trace | - | 0.000247 | 251/740 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 9" | code_trace | - | 0.000174 | 187/518 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 5, 10, 12, 4, 6, 3]" | code_trace | - | 0.000238 | 252/709 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 5, 10, 12, 4, 6, 3]" | code_trace | - | 0.000252 | 256/756 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 9" | code_trace | - | 0.000170 | 191/503 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 9" | code_trace | - | 0.000179 | 196/531 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 9" | code_trace | - | 0.000161 | 187/473 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 87" | code_trace | - | 0.000213 | 215/639 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 87" | code_trace | - | 0.000216 | 228/644 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 87" | code_trace | - | 0.000224 | 219/672 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 87" | code_trace | - | 0.000230 | 213/696 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 38" | code_trace | - | 0.000222 | 218/668 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 38" | code_trace | - | 0.000205 | 222/608 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 38" | code_trace | - | 0.000240 | 219/727 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 38" | code_trace | - | 0.000236 | 218/714 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: -1089" | code_trace | - | 0.000289 | 253/880 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: -1089" | code_trace | - | 0.000289 | 257/878 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: -1089" | code_trace | - | 0.000284 | 248/863 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [7, 0, 2, 9, 5, 10, 5, 2, 7]" | code_trace | - | 0.000238 | 249/712 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [7, 0, 2, 9, 5, 10, 5, 2, 7]" | code_trace | - | 0.000255 | 253/765 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [7, 0, 2, 9, 5, 10, 5, 2, 7]" | code_trace | - | 0.000241 | 249/719 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [13, 9, 5, 7, 17, 52, 1, 2, 3, 4, 3, 8, 50, 36]" | code_trace | - | 0.000350 | 314/1063 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [13, 9, 5, 7, 17, 52, 1, 2, 3, 4, 3, 8, 50, 36]" | code_trace | - | 0.000391 | 326/1193 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [13, 9, 5, 7, 17, 52, 1, 2, 3, 4, 3, 8, 50, 36]" | code_trace | - | 0.000369 | 319/1123 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 23" | code_trace | - | 0.000216 | 292/621 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [13, 9, 5, 7, 17, 52, 1, 2, 3, 4, 3, 8, 50, 36]" | code_trace | - | 0.000345 | 312/1046 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 23" | code_trace | - | 0.000228 | 293/662 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 23" | code_trace | - | 0.000229 | 307/662 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 23" | code_trace | - | 0.000195 | 296/551 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 23" | code_trace | - | 0.000223 | 292/646 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 26" | code_trace | - | 0.000218 | 256/642 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 26" | code_trace | - | 0.000195 | 228/573 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 3, 5, 1, 'tkt-375775#done']" | code_trace | - | 0.000205 | 222/611 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 3, 5, 1, 'tkt-375775#done']" | code_trace | - | 0.000203 | 225/601 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 3, 5, 1, 'tkt-375775#done']" | code_trace | - | 0.000178 | 221/521 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 89" | code_trace | - | 0.000255 | 302/749 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 89" | code_trace | - | 0.000261 | 303/770 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 89" | code_trace | - | 0.000262 | 306/770 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 89" | code_trace | - | 0.000252 | 302/740 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 67" | code_trace | - | 0.000194 | 214/574 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 67" | code_trace | - | 0.000181 | 220/531 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 67" | code_trace | - | 0.000203 | 210/608 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 47" | code_trace | - | 0.000198 | 168/604 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 47" | code_trace | - | 0.000190 | 183/571 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 47" | code_trace | - | 0.000189 | 172/573 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 47" | code_trace | - | 0.000180 | 168/543 | full transcript → |