Run camp-ef-comments-gemma4qat-001/B
PASSEDWhat this run revealed, then every individual trial as evidence.
10
Trials
100%
10/10 scored
over trials
Pass rate
0
Failures
$0.0016
Run cost
Run camp-ef-comments-gemma4qat-001/B: passed essentially everything (100%) -- this test did not challenge the model.
Of 10 scored trials (code query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 2, 7, 24, 2]" | code_trace | - | 0.000159 | 217/459 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 2, 6]" | code_trace | - | 0.000169 | 187/502 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 11" | code_trace | - | 0.000169 | 208/493 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 12" | code_trace | - | 0.000123 | 157/358 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 9" | code_trace | - | 0.000138 | 167/404 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 0, 1, 1, 9, 9, 7, 7, 1, 9, 7, 3, 2]" | code_trace | - | 0.000220 | 218/661 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 19" | code_trace | - | 0.000143 | 188/414 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 20" | code_trace | - | 0.000127 | 173/366 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 8" | code_trace | - | 0.000134 | 179/386 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 5, 78, 2]" | code_trace | - | 0.000187 | 202/555 | full transcript → |