Run camp-tool-deep-nano-001
29% PASSWhat this run revealed, then every individual trial as evidence.
7
Trials
29%
2/7 scored
over trials
Pass rate
5
Failures
$0.0029
Run cost
Run camp-tool-deep-nano-001: 29% pass rate on tool queries.
Of 7 scored trials (tool query kind), the model passed 29% and failed 71%.
5 failure(s) recorded; failures not yet verified -- use "Verify failures" on this page (or scripts/verify_past_failures.py).
Notable failures
- record 5d827849 expected: (unknown)actual: ]
- record 12276700 expected: (unknown)actual: ]
- record 0a5587f3 expected: (unknown)actual: ]
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000270 | 783/1156 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ?FAILanswered "]" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000378 | 783/1692 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ?FAILanswered "]" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000440 | 786/2005 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ?FAILanswered "]" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000454 | 784/2075 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ?FAILanswered "]" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000462 | 788/2111 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "]" | tool_plan | - | 0.000596 | 787/2782 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ?FAILanswered "]" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000349 | 784/1548 | full transcript → |