Run camp-code-repair-confirm-gemma4qat-postfix-001

40% PASS

What this run revealed, then every individual trial as evidence.

Trials

40%

2/5 scored

over trials

Pass rate

60%

Failures

$0.0040

Run cost

Run camp-code-repair-confirm-gemma4qat-postfix-001, 1 arms: clean on none; below 97% on trace.

Arm trace: 80% pass rate across 5 trials.

(trace) 1 failure(s) recorded; failures not yet verified -- use "Verify failures" on this page (or scripts/verify_past_failures.py).

record 6090200f — asked "After this program runs, what is the value of `rate`? Work through it carefully, then give the final answer on its own last line as `ANSWER: <python literal>`."
expected: (unknown)
actual: ANSWER: 48
answer did not match the verified ground truth

Trials5 trials

Per-trial table (5 trials -- prompt, reasoning, verdict, answer key)

model	verdict	kind	difficulty	cost ($)	tokens in/out
gemma-4-31b-it-qat-w4a16-ct	✓PASSanswered "```"	code_repair	-	0.000416	452/1236	full transcript →
gemma-4-31b-it-qat-w4a16-ct	✓PASSanswered "```"	code_repair	-	0.000855	350/2733	full transcript →
gemma-4-31b-it-qat-w4a16-ct	?FAILanswered "```"unverified	code_repair	-	0.000533	379/1649	full transcript →
gemma-4-31b-it-qat-w4a16-ct	?FAILanswered "```"unverified	code_repair	-	0.000490	475/1474	full transcript →
gemma-4-31b-it-qat-w4a16-ct	?FAILanswered "```"unverified	code_repair	-	0.001697	366/5536	full transcript →