Run camp-full_map-nano-002/state
PASSEDWhat this run revealed, then every individual trial as evidence.
30
Trials
100%
30/30 scored
over trials
Pass rate
0
Failures
$0.0046
Run cost
Run camp-full_map-nano-002/state: passed essentially everything (100%) -- this test did not challenge the model.
Of 30 scored trials (state query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "storage room" | state | - | 0.000032 | 133/126 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "photo studio" | state | - | 0.000040 | 131/165 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "courtyard" | state | - | 0.000045 | 128/192 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "courtyard" | state | - | 0.000054 | 134/237 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "utility closet" | state | - | 0.000056 | 140/244 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "boiler room" | state | - | 0.000078 | 265/325 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "observation deck" | state | - | 0.000116 | 268/513 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "storage room" | state | - | 0.000123 | 272/545 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "boiler room" | state | - | 0.000108 | 255/477 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "loading dock" | state | - | 0.000130 | 383/553 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "east wing" | state | - | 0.000137 | 406/581 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "cafeteria" | state | - | 0.000167 | 256/771 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "cafeteria" | state | - | 0.000135 | 405/574 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "mail room" | state | - | 0.000131 | 401/554 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "south stairwell" | state | - | 0.000151 | 398/657 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "atrium" | state | - | 0.000165 | 519/697 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "rooftop terrace" | state | - | 0.000115 | 663/408 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "mail room" | state | - | 0.000197 | 518/853 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "print room" | state | - | 0.000201 | 519/873 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "storage room" | state | - | 0.000227 | 641/976 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "archive room" | state | - | 0.000141 | 504/577 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "photo studio" | state | - | 0.000203 | 657/849 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "east wing" | state | - | 0.000230 | 649/990 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "photo studio" | state | - | 0.000235 | 629/1020 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "west wing" | state | - | 0.000190 | 525/819 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "cafeteria" | state | - | 0.000170 | 679/681 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "photo studio" | state | - | 0.000240 | 682/1028 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "print room" | state | - | 0.000278 | 657/1227 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "supply closet" | state | - | 0.000297 | 667/1320 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "south stairwell" | state | - | 0.000198 | 625/835 | full transcript → |