Run camp-code-stack-gemma4qat-001
PASSEDWhat this run revealed, then every individual trial as evidence.
33
Trials
100%
33/33 scored
over trials
Pass rate
0
Failures
$0.0087
Run cost
Run camp-code-stack-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.
Of 33 scored trials (code query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 14" | code_trace | - | 0.000198 | 238/580 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [7, 1, 5, 4, 5]" | code_trace | - | 0.000212 | 260/619 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 8, 3, 6, 7, 7]" | code_trace | - | 0.000242 | 250/725 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [1, 8, 4, 6, 4, 4]" | code_trace | - | 0.000269 | 244/815 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 10" | code_trace | - | 0.000202 | 251/590 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 44" | code_trace | - | 0.000184 | 236/534 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 44" | code_trace | - | 0.000186 | 224/544 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 23" | code_trace | - | 0.000215 | 244/635 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 7" | code_trace | - | 0.000242 | 242/726 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 1, 3, 1, 22]" | code_trace | - | 0.000189 | 236/553 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 31" | code_trace | - | 0.000219 | 252/646 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 28" | code_trace | - | 0.000225 | 254/665 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 2, 30, 18]" | code_trace | - | 0.000233 | 240/697 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 4" | code_trace | - | 0.000213 | 247/629 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 26" | code_trace | - | 0.000213 | 236/632 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 36" | code_trace | - | 0.000217 | 213/653 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [0, 3, 8, 3, 2, 7, 14]" | code_trace | - | 0.000273 | 242/828 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 73" | code_trace | - | 0.000248 | 243/746 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 104" | code_trace | - | 0.000254 | 251/763 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 40" | code_trace | - | 0.000271 | 241/822 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 61" | code_trace | - | 0.000301 | 265/914 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 84" | code_trace | - | 0.000309 | 279/938 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 36" | code_trace | - | 0.000311 | 278/944 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 41" | code_trace | - | 0.000317 | 267/969 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 40" | code_trace | - | 0.000335 | 277/1023 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 81" | code_trace | - | 0.000299 | 294/898 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 107" | code_trace | - | 0.000324 | 281/988 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 4, 3, 1, 3, 6, 53, 20, 27]" | code_trace | - | 0.000351 | 298/1071 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 123" | code_trace | - | 0.000357 | 296/1091 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 69" | code_trace | - | 0.000295 | 304/882 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 81" | code_trace | - | 0.000337 | 327/1016 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 127" | code_trace | - | 0.000336 | 296/1022 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 318" | code_trace | - | 0.000343 | 304/1041 | full transcript → |