Run camp-ef-comments-gemma4qat-001/E
PASSEDWhat this run revealed, then every individual trial as evidence.
10
Trials
100%
10/10 scored
over trials
Pass rate
0
Failures
$0.0016
Run cost
Run camp-ef-comments-gemma4qat-001/E: passed essentially everything (100%) -- this test did not challenge the model.
Of 10 scored trials (code query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 2, 7, 24, 2]" | code_trace | - | 0.000161 | 219/465 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 2, 6]" | code_trace | - | 0.000166 | 188/490 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 11" | code_trace | - | 0.000173 | 210/508 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 12" | code_trace | - | 0.000131 | 157/385 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 9" | code_trace | - | 0.000166 | 168/497 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 0, 1, 1, 9, 9, 7, 7, 1, 9, 7, 3, 2]" | code_trace | - | 0.000209 | 220/625 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000149 | 189/435 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 20" | code_trace | - | 0.000127 | 174/365 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 8" | code_trace | - | 0.000133 | 180/384 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 5, 78, 2]" | code_trace | - | 0.000186 | 204/552 | full transcript → |