Run camp-order-gemma4qat-001

Run camp-order-gemma4qat-001: 95% pass rate on order queries.

Of 105 scored trials (order query kind), the model passed 95% and failed 5%.

5 failure(s) recorded; failures not yet verified -- use "Verify failures" on this page (or scripts/verify_past_failures.py).

Diffuse weakness (below 90% but no outright flip) on: context_length (pass rate 89% at the high end), distractors (pass rate 84% at the high end), entity_state (pass rate 84% at the high end), temporal (pass rate 80% at the high end).

Notable failures

• record f52359a0 — asked "Which happened first: Wren moving the cracked folder to the mail room or Wren's aside? Answer 'first' if the former, 'second' if the latter."
  expected: first
  actual: Since neither event described in your question actually occurred as stated, the question cannot b...

  the model recovered narration order, not the true event timestamps

• record d277d66b — asked "Which happened first: Nolan moving the old basket to the workshop or Silas's aside? Answer 'first' if the former, 'second' if the latter."
  expected: first
  actual: first

  the model recovered narration order, not the true event timestamps

• record eb07092d — asked "Which happened first: Tamsin moving the old tablet to the gym or Tamsin's aside? Answer 'first' if the former, 'second' if the latter."
  expected: first
  actual: first

  the model recovered narration order, not the true event timestamps