Run camp-code-pairtrace-xcheck-gemma4qat-001

Run camp-code-pairtrace-xcheck-gemma4qat-001: 50% pass rate on code queries.

Of 32 scored trials (code query kind), the model passed 50% and failed 50%.

16 failure(s) recorded; failures not yet verified -- use "Verify failures" on this page (or scripts/verify_past_failures.py).

Sharp boundary detected on: n_foil_matches (high-end pass rate 0%).

Notable failures

• record df436d14 — asked "After this program runs, what is the value of `spare`? Work through it carefully, then give the final answer on its own last line as `ANSWER: <python literal>`."
  expected: (unknown)
  actual: ANSWER: 56

  answer did not match the verified ground truth

• record 6595e1cd — asked "After this program runs, what is the value of `spare`? Work through it carefully, then give the final answer on its own last line as `ANSWER: <python literal>`."
  expected: (unknown)
  actual: ANSWER: 56

  answer did not match the verified ground truth

• record 6c7623c9 — asked "After this program runs, what is the value of `spare`? Work through it carefully, then give the final answer on its own last line as `ANSWER: <python literal>`."
  expected: (unknown)
  actual: ANSWER: 56

  answer did not match the verified ground truth