Run camp-propose-toolworld-001/control
79% PASSWhat this run revealed, then every individual trial as evidence.
20
6 errors
Trials
79%
11/14 scored
over trials
Pass rate
3
Failures
$0.0105
Run cost
Run camp-propose-toolworld-001/control: 79% pass rate on tool queries.
Of 14 scored trials (tool query kind), the model passed 79% and failed 21%.
6 additional trial(s) ended in ERROR (infra failures, cost cap, or cancellation) and are excluded from the pass rate above.
3 failure(s) recorded; failures not yet verified -- use "Verify failures" on this page (or scripts/verify_past_failures.py).
Notable failures
- record 79dac819 expected: (unknown)actual: ]
- record 3628cbcd expected: (unknown)actual: ]
- record 82ccae20 expected: (unknown)actual: ]
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ?FAILanswered "]" (world seeded for: poison_traps=0)unverified | tool_plan | - | 0.000598 | 884/2770 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000769 | 893/3620 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000673 | 897/3139 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000440 | 892/1978 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000636 | 889/2957 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕ERRORlength | tool_plan | - | 0.000841 | 827/4000 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕ERRORlength | tool_plan | - | 0.000842 | 831/4000 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕ERRORlength | tool_plan | - | 0.000841 | 824/4000 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕ERRORlength | tool_plan | - | 0.000841 | 819/4000 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕ERRORlength | tool_plan | - | 0.000843 | 852/4000 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000314 | 964/1330 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕ERRORlength | tool_plan | - | 0.000348 | 950/1500 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000323 | 962/1376 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000334 | 955/1433 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000316 | 953/1342 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000320 | 809/1400 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ?FAILanswered "]" (world seeded for: poison_traps=0)unverified | tool_plan | - | 0.000304 | 816/1316 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000340 | 807/1500 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000277 | 805/1186 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ?FAILanswered "]" (world seeded for: poison_traps=0)unverified | tool_plan | - | 0.000276 | 806/1180 | full transcript → |