Run camp-tool_bp-nano-001

Run camp-tool_bp-nano-001: 66% pass rate on tool queries.

Of 144 scored trials (tool query kind), the model passed 66% and failed 34%.

10 additional trial(s) ended in ERROR (infra failures, cost cap, or cancellation) and are excluded from the pass rate above.

49 failure(s) recorded; failures not yet verified -- use "Verify failures" on this page (or scripts/verify_past_failures.py).

Sharp boundary detected on: implicit_preconditions_on (high-end pass rate 46%).

Diffuse weakness (below 90% but no outright flip) on: zero_slack_on (pass rate 51% at the high end).

Notable failures

• record 96f68659 — asked "You may use at most 9 tool calls."
  expected: (unknown)
  actual: ]

  answer did not match the verified ground truth

• record eaa0cb9c — asked "You may use at most 9 tool calls."
  expected: (unknown)
  actual: ]

  answer did not match the verified ground truth

• record 47ff64fe — asked "You may use at most 9 tool calls."
  expected: (unknown)
  actual: ]

  answer did not match the verified ground truth