Run camp-interactive-fault-nano-001

Run camp-interactive-fault-nano-001: 87% pass rate on interactive queries.

Of 23 scored trials (interactive query kind), the model passed 87% and failed 13%.

2 additional trial(s) ended in ERROR (infra failures, cost cap, or cancellation) and are excluded from the pass rate above.

3 failure(s) recorded; failures not yet verified -- use "Verify failures" on this page (or scripts/verify_past_failures.py).

Sharp boundary detected on: final_distance (high-end pass rate 0%).

Diffuse weakness (below 90% but no outright flip) on: catalog_size (pass rate 88% at the high end), chain_length (pass rate 88% at the high end), n_errors (pass rate 50% at the high end), n_links (pass rate 88% at the high end), realized_plan_depth (pass rate 88% at the high end).

Notable failures

• record a31d0d40 — asked "You may make at most 23 tool calls."
  expected: (unknown)
  actual: []

  answer did not match the verified ground truth

• record a7ad4298 — asked "You may make at most 23 tool calls."
  expected: (unknown)
  actual: [{"step": 1, "tool": "build_art_0", "args": {"artifact": "art_0"}, "ok": true, "error_kind": null...

  answer did not match the verified ground truth

• record 8d8561ba — asked "You may make at most 25 tool calls."
  expected: (unknown)
  actual: [{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag_0"}, "ok": true, "error_kind": null, "r...

  answer did not match the verified ground truth