Run camp-interactive-lookalike-nano-001

Run camp-interactive-lookalike-nano-001: 53% pass rate on interactive queries.

Of 36 scored trials (interactive query kind), the model passed 53% and failed 47%.

9 additional trial(s) ended in ERROR (infra failures, cost cap, or cancellation) and are excluded from the pass rate above.

17 failure(s) recorded; failures not yet verified -- use "Verify failures" on this page (or scripts/verify_past_failures.py).

Sharp boundary detected on: final_distance (high-end pass rate 0%).

Notable failures

• record 22ba949c — asked "You may make at most 14 tool calls."
  expected: (unknown)
  actual: [{"step": 1, "tool": "build-_art_0", "args": {"artifact": "art_0"}, "ok": true, "error_kind": nul...

  answer did not match the verified ground truth

• record 4d0d7dd5 — asked "You may make at most 18 tool calls."
  expected: (unknown)
  actual: [{"step": 1, "tool": "build_art_o0", "args": {"artifact": "art_0"}, "ok": true, "error_kind": nul...

  answer did not match the verified ground truth

• record 67f49d91 — asked "You may make at most 22 tool calls."
  expected: (unknown)
  actual: [{"step": 1, "tool": "set_flag_o0", "args": {"flag": "flag_0"}, "ok": true, "error_kind": null, "...

  answer did not match the verified ground truth