Run camp-ef-comments-gemma4qat-001/A
PASSEDWhat this run revealed, then every individual trial as evidence.
10
Trials
100%
10/10 scored
over trials
Pass rate
0
Failures
$0.0015
Run cost
Run camp-ef-comments-gemma4qat-001/A: passed essentially everything (100%) -- this test did not challenge the model.
Of 10 scored trials (code query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 2, 7, 24, 2]" | code_trace | - | 0.000143 | 190/413 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 2, 6]" | code_trace | - | 0.000150 | 167/443 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 11" | code_trace | - | 0.000181 | 203/537 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 12" | code_trace | - | 0.000115 | 151/333 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 9" | code_trace | - | 0.000151 | 161/451 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 0, 1, 1, 9, 9, 7, 7, 1, 9, 7, 3, 2]" | code_trace | - | 0.000197 | 182/595 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000145 | 173/427 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 20" | code_trace | - | 0.000119 | 166/343 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 8" | code_trace | - | 0.000141 | 167/415 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 5, 78, 2]" | code_trace | - | 0.000186 | 187/558 | full transcript → |