Run camp-code-copy-gemma4qat-001
PASSEDWhat this run revealed, then every individual trial as evidence.
24
1 error
Trials
100%
23/23 scored
over trials
Pass rate
0
Failures
$0.0047
Run cost
Run camp-code-copy-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.
Of 23 scored trials (code query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
1 additional trial(s) ended in ERROR (infra failures, cost cap, or cancellation) and are excluded from the pass rate above.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 25" | code_trace | - | 0.000100 | 110/296 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 14" | code_trace | - | 0.000100 | 103/298 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 30" | code_trace | - | 0.000101 | 110/301 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 12" | code_trace | - | 0.000124 | 138/368 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 10" | code_trace | - | 0.000129 | 132/385 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕ERRORtimeout | code_trace | - | 0.000000 | 0/0 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 7" | code_trace | - | 0.000114 | 150/330 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 4, 4, 8, -6]" | code_trace | - | 0.000195 | 152/601 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [3, 6, 7, 9, 16]" | code_trace | - | 0.000225 | 164/696 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 17" | code_trace | - | 0.000154 | 172/455 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 24" | code_trace | - | 0.000193 | 207/573 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: 69" | code_trace | - | 0.000201 | 233/591 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 1, 'tkt-34af1e/ok', -1, 3]" | code_trace | - | 0.000191 | 211/567 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [7, 9, 9, 0, 'tkt-d59910:v2', 3]" | code_trace | - | 0.000206 | 246/606 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [8, 4, 2, 'tkt-d71f9a#done', 14, 4]" | code_trace | - | 0.000237 | 248/706 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 8, 8, 5, 5, 'tkt-1a6dbb:v2', 2]" | code_trace | - | 0.000232 | 272/684 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 2, 8, 2, 2, 'tkt-079f9d#done']" | code_trace | - | 0.000245 | 262/729 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [9, 2, 2, 2, 'tkt-a65dd5#done']" | code_trace | - | 0.000251 | 271/747 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [2, 0, 0, 3, 'tkt-2a8d58/ok']" | code_trace | - | 0.000244 | 303/711 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [4, 9, 5, 3, 'tkt-af1038:v2']" | code_trace | - | 0.000251 | 317/730 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [6, 3, 7, 7, 'tkt-af7d25#done']" | code_trace | - | 0.000269 | 281/804 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [7, 0, 4, 'tkt-894d15/ok', 'tkt-894d15/ok', 1]" | code_trace | - | 0.000288 | 309/857 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [1, 6, 4, 18, 'tkt-4c2ed9:v2']" | code_trace | - | 0.000299 | 316/891 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "ANSWER: [5, 7, 3, 4, -3, 'tkt-e8c97b#done']" | code_trace | - | 0.000335 | 317/1012 | full transcript → |