Run camp-code-lookalike-gemma4qat-001
PASSEDWhat this run revealed, then every individual trial as evidence.
56
Trials
100%
56/56 scored
over trials
Pass rate
0
Failures
$0.0139
Run cost
Run camp-code-lookalike-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.
Of 56 scored trials (code query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 23" | code_trace | - | 0.000084 | 94/249 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 21" | code_trace | - | 0.000088 | 107/258 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 27" | code_trace | - | 0.000089 | 111/260 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 5, 8, 8, 5]" | code_trace | - | 0.000119 | 122/355 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 24" | code_trace | - | 0.000132 | 130/398 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 9, 4, 3]" | code_trace | - | 0.000118 | 143/346 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 15" | code_trace | - | 0.000098 | 117/288 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 17" | code_trace | - | 0.000110 | 132/323 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 17" | code_trace | - | 0.000132 | 145/392 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 15" | code_trace | - | 0.000137 | 147/408 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 16" | code_trace | - | 0.000143 | 157/425 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [0, 2, 1, 0, 3]" | code_trace | - | 0.000153 | 177/451 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 16" | code_trace | - | 0.000176 | 147/537 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 15" | code_trace | - | 0.000123 | 136/366 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 14" | code_trace | - | 0.000150 | 224/427 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 21" | code_trace | - | 0.000166 | 171/498 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 17" | code_trace | - | 0.000143 | 207/407 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 15" | code_trace | - | 0.000172 | 202/506 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 45" | code_trace | - | 0.000192 | 199/574 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [3, 3, 1, 4, 2, 18]" | code_trace | - | 0.000260 | 221/794 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [1, 7, 8, 8, 3]" | code_trace | - | 0.000277 | 216/852 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 9" | code_trace | - | 0.000196 | 230/576 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 16" | code_trace | - | 0.000204 | 265/591 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 48" | code_trace | - | 0.000258 | 253/775 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 4, 0, 4, 2, 4, 9, 4, 0]" | code_trace | - | 0.000272 | 299/808 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 5" | code_trace | - | 0.000218 | 240/647 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 8, 8, 2, 5, 5, 7, 7, 6, 6, 0, 0, 3, 3, 6, 6, ..." | code_trace | - | 0.000319 | 284/970 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 6" | code_trace | - | 0.000339 | 266/1041 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 15" | code_trace | - | 0.000228 | 302/659 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 14" | code_trace | - | 0.000228 | 298/661 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 17" | code_trace | - | 0.000246 | 293/721 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 4, 3, 3]" | code_trace | - | 0.000301 | 350/887 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 21" | code_trace | - | 0.000346 | 315/1048 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [0, 7, 4, 1, 3]" | code_trace | - | 0.000310 | 329/923 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 2, 3, 9, 9, 4, 4, 1, 1, 0, 0, 3, 3, 5, 9, 9, ..." | code_trace | - | 0.000363 | 294/1111 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 82" | code_trace | - | 0.000262 | 302/772 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 8" | code_trace | - | 0.000272 | 335/796 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 14" | code_trace | - | 0.000277 | 332/814 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 20" | code_trace | - | 0.000290 | 353/848 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 30" | code_trace | - | 0.000289 | 314/859 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 0, 1, 3]" | code_trace | - | 0.000328 | 420/953 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 18" | code_trace | - | 0.000309 | 338/917 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 18" | code_trace | - | 0.000316 | 406/918 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 35" | code_trace | - | 0.000329 | 373/971 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 22" | code_trace | - | 0.000332 | 360/987 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 1, 2, 4, 82]" | code_trace | - | 0.000339 | 378/1004 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 1, 4, 24, 3, 8]" | code_trace | - | 0.000345 | 379/1025 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 9" | code_trace | - | 0.000315 | 349/933 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 39" | code_trace | - | 0.000458 | 410/1390 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 16" | code_trace | - | 0.000333 | 401/977 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 25" | code_trace | - | 0.000336 | 409/982 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 18" | code_trace | - | 0.000338 | 437/982 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 23" | code_trace | - | 0.000373 | 439/1098 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 30" | code_trace | - | 0.000396 | 463/1165 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 44" | code_trace | - | 0.000431 | 430/1295 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [1, 3, 5, -12, 2]" | code_trace | - | 0.000330 | 418/962 | full transcript → |