Run camp-ef-comments-gemma4qat-001/D
PASSEDWhat this run revealed, then every individual trial as evidence.
10
Trials
100%
10/10 scored
over trials
Pass rate
0
Failures
$0.0015
Run cost
Run camp-ef-comments-gemma4qat-001/D: passed essentially everything (100%) -- this test did not challenge the model.
Of 10 scored trials (code query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 2, 7, 24, 2]" | code_trace | - | 0.000151 | 219/432 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 2, 6]" | code_trace | - | 0.000158 | 189/465 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 11" | code_trace | - | 0.000165 | 210/481 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 12" | code_trace | - | 0.000125 | 159/364 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 9" | code_trace | - | 0.000150 | 169/445 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 0, 1, 1, 9, 9, 7, 7, 1, 9, 7, 3, 2]" | code_trace | - | 0.000218 | 220/652 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000143 | 190/414 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 20" | code_trace | - | 0.000114 | 175/323 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 8" | code_trace | - | 0.000137 | 181/396 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 5, 78, 2]" | code_trace | - | 0.000171 | 204/502 | full transcript → |