Run camp-tool_bp-ultra-001

Run camp-tool_bp-ultra-001: 91% pass rate on tool queries.

Of 56 scored trials (tool query kind), the model passed 91% and failed 9%.

5 failure(s) recorded; failures not yet verified -- use "Verify failures" on this page (or scripts/verify_past_failures.py).

Diffuse weakness (below 90% but no outright flip) on: catalog_size (pass rate 86% at the high end), chain_length (pass rate 86% at the high end), irreversibility (pass rate 82% at the high end), parallel_goals (pass rate 82% at the high end), realized_plan_depth (pass rate 86% at the high end).

Notable failures

• record f0ff4c54 — asked "You may use at most 9 tool calls."
  expected: (unknown)
  actual: ]

  answer did not match the verified ground truth

• record 28209807 — asked "You may use at most 9 tool calls."
  expected: (unknown)
  actual: ]

  answer did not match the verified ground truth

• record b4e8c7d8 — asked "You may use at most 10 tool calls."
  expected: (unknown)
  actual: ]

  answer did not match the verified ground truth