Run camp-tool-depth-super-002/captokens
60% PASSWhat this run revealed, then every individual trial as evidence.
10
Trials
60%
6/10 scored
over trials
Pass rate
4
Failures
$0.0179
Run cost
Run camp-tool-depth-super-002/captokens: 60% pass rate on tool queries.
Of 10 scored trials (tool query kind), the model passed 60% and failed 40%.
4 failure(s) recorded; failures not yet verified -- use "Verify failures" on this page (or scripts/verify_past_failures.py).
Notable failures
- record f5392068 expected: (unknown)actual: ]
- record c248372a expected: (unknown)actual: ]
- record 5b377c71 expected: (unknown)actual: ]
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| nvidia/nemotron-3-super-120b-a12b | ?FAILanswered "]" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.001357 | 1419/2763 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.001807 | 1571/3736 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.001719 | 1643/3528 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.001816 | 1641/3743 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.001869 | 1642/3861 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ?FAILanswered "]" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.002239 | 1572/4695 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ?FAILanswered "]" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.001877 | 1573/3892 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ?FAILanswered "]" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.001462 | 1571/2969 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.001728 | 1573/3561 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.002064 | 1569/4308 | full transcript → |