Run camp-propose-toolworld-001/round3
79% PASSWhat this run revealed, then every individual trial as evidence.
20
1 error
Trials
79%
15/19 scored
over trials
Pass rate
4
Failures
$0.0090
Run cost
Run camp-propose-toolworld-001/round3: 79% pass rate on tool queries.
Of 19 scored trials (tool query kind), the model passed 79% and failed 21%.
1 additional trial(s) ended in ERROR (infra failures, cost cap, or cancellation) and are excluded from the pass rate above.
4 failure(s) recorded; failures not yet verified -- use "Verify failures" on this page (or scripts/verify_past_failures.py).
Notable failures
- record afad433b expected: (unknown)actual: ]
- record 5218e1a5 expected: (unknown)actual: ]
- record 02ba1d1a expected: (unknown)actual: ]
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000607 | 1045/2772 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "[{"tool":"build_art_0","args":{"artifact":"art_0"}},{"too..." | tool_plan | - | 0.000734 | 1053/3406 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000583 | 1050/2653 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000456 | 1040/2019 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000569 | 1047/2583 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "[{"tool":"advance_o0","args":{"service":"svc_0"}},{"tool"..." | tool_plan | - | 0.000200 | 507/875 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000157 | 521/653 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ?FAILanswered "]" (world seeded for: poison_traps=0)unverified | tool_plan | - | 0.000263 | 510/1186 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000208 | 508/914 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000154 | 515/639 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000556 | 1069/2515 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000831 | 1054/3890 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000390 | 1053/1688 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000707 | 1067/3270 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000566 | 1073/2564 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000592 | 813/2756 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ?FAILanswered "]" (world seeded for: poison_traps=0)unverified | tool_plan | - | 0.000459 | 814/2093 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕ERRORlength | tool_plan | - | 0.000341 | 823/1500 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ?FAILanswered "]" (world seeded for: poison_traps=0)unverified | tool_plan | - | 0.000279 | 810/1193 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ?FAILanswered "]" (world seeded for: poison_traps=0)unverified | tool_plan | - | 0.000313 | 807/1361 | full transcript → |