Run camp-tool-count-super-001
PASSEDWhat this run revealed, then every individual trial as evidence.
56
Trials
100%
56/56 scored
over trials
Pass rate
0
Failures
$0.0299
Run cost
Run camp-tool-count-super-001: passed essentially everything (100%) -- this test did not challenge the model.
Of 56 scored trials (tool query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000320 | 727/581 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000373 | 727/699 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000346 | 725/641 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000397 | 724/753 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000510 | 725/1005 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000516 | 723/1018 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000418 | 727/800 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000493 | 1103/900 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000477 | 1102/863 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000545 | 1103/1015 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000502 | 1104/920 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000493 | 1106/899 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000569 | 1106/1068 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000510 | 1104/938 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000396 | 1446/622 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000481 | 1443/813 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"build_art_0","args":{"artifact":"art_0"}},{"too..." | tool_plan | - | 0.000525 | 1441/910 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000521 | 1446/900 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000481 | 1443/812 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000564 | 1445/997 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000448 | 1446/739 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000425 | 1829/620 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000529 | 1831/851 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000514 | 1832/816 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000473 | 1832/726 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000535 | 1832/863 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000708 | 1830/1248 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000583 | 1831/971 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000421 | 2216/542 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000465 | 2215/639 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000478 | 2214/669 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000499 | 2217/714 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000544 | 2215/814 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000622 | 2215/988 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000536 | 2214/797 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000533 | 2604/721 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000601 | 2603/872 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000508 | 2600/667 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000659 | 2603/1002 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000598 | 2602/866 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000622 | 2601/919 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000563 | 2604/788 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000498 | 2944/583 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}, {"t..." | tool_plan | - | 0.000491 | 2946/567 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000559 | 2945/719 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000617 | 2942/848 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000624 | 2945/862 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000655 | 2946/932 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000616 | 2947/846 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"build_art_0","args":{"artifact":"art_0"}},{"too..." | tool_plan | - | 0.000632 | 3200/835 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000646 | 3201/867 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000665 | 3202/908 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000675 | 3203/931 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000629 | 3201/829 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000659 | 3200/896 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000616 | 3202/799 | full transcript → |