Run camp-determinism-probe-gemma4qat-001
30% PASSWhat this run revealed, then every individual trial as evidence.
30
Trials
30%
9/30 scored
over trials
Pass rate
21
Failures
$0.0188
Run cost
Run camp-determinism-probe-gemma4qat-001, 2 arms: clean on none; below 97% on parallel, serial.
Arm parallel: 27% pass rate across 15 trials.
(parallel) 11 failure(s) recorded; failures not yet verified -- use "Verify failures" on this page (or scripts/verify_past_failures.py).
Arm serial: 33% pass rate across 15 trials.
(serial) 10 failure(s) recorded; failures not yet verified -- use "Verify failures" on this page (or scripts/verify_past_failures.py).
Notable failures
- record 5f1d8e71 expected: (unknown)actual: ```
- record 9f95e142 expected: (unknown)actual: ```
- record 7b2c42df expected: (unknown)actual: ```
Trials
Per-trial table
| model | stage | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | parallel | ✓PASSanswered "```" | code_repair | - | 0.000361 | 459/1051 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | parallel | ✓PASSanswered "```" | code_repair | - | 0.000361 | 459/1051 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | parallel | ✓PASSanswered "```" | code_repair | - | 0.000361 | 459/1051 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | parallel | ?FAILanswered "```"unverified | code_repair | - | 0.000426 | 459/1268 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | parallel | ?FAILanswered "```"unverified | code_repair | - | 0.000405 | 386/1220 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | parallel | ?FAILanswered "```"unverified | code_repair | - | 0.000405 | 386/1220 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | parallel | ?FAILanswered "```"unverified | code_repair | - | 0.000426 | 459/1268 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | parallel | ?FAILanswered "```"unverified | code_repair | - | 0.000312 | 364/920 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | parallel | ?FAILanswered "```"unverified | code_repair | - | 0.000700 | 386/2206 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | parallel | ✓PASSanswered "```" | code_repair | - | 0.000306 | 364/898 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | parallel | ?FAILanswered "```"unverified | code_repair | - | 0.000312 | 364/920 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | parallel | ?FAILanswered "```"unverified | code_repair | - | 0.000313 | 364/921 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | parallel | ?FAILanswered "```"unverified | code_repair | - | 0.000312 | 364/920 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | parallel | ?FAILanswered "```"unverified | code_repair | - | 0.001892 | 386/6178 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | parallel | ?FAILanswered "```"unverified | code_repair | - | 0.001892 | 386/6178 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | serial | ?FAILanswered "```"unverified | code_repair | - | 0.000561 | 459/1717 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | serial | ✓PASSanswered "```" | code_repair | - | 0.000361 | 459/1051 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | serial | ✓PASSanswered "```" | code_repair | - | 0.000361 | 459/1051 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | serial | ✓PASSanswered "```" | code_repair | - | 0.000361 | 459/1051 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | serial | ✓PASSanswered "```" | code_repair | - | 0.000361 | 459/1051 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | serial | ?FAILanswered "```"unverified | code_repair | - | 0.000327 | 386/962 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | serial | ?FAILanswered "```"unverified | code_repair | - | 0.001436 | 386/4658 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | serial | ?FAILanswered "```"unverified | code_repair | - | 0.001436 | 386/4658 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | serial | ?FAILanswered "```"unverified | code_repair | - | 0.001436 | 386/4658 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | serial | ?FAILanswered "```"unverified | code_repair | - | 0.001436 | 386/4658 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | serial | ✓PASSanswered "```" | code_repair | - | 0.000644 | 364/2025 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | serial | ?FAILanswered "```"unverified | code_repair | - | 0.000312 | 364/920 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | serial | ?FAILanswered "```"unverified | code_repair | - | 0.000312 | 364/920 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | serial | ?FAILanswered "```"unverified | code_repair | - | 0.000312 | 364/920 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | serial | ?FAILanswered "```"unverified | code_repair | - | 0.000312 | 364/920 | full transcript → |