Run camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/adversarial_belief
90% PASSWhat this run revealed, then every individual trial as evidence.
160
3 errors
Trials
93%
142/153 scored
over trials
Pass rate
15
11 stable / 4 noise
Failures
$0.0229
Run cost
Run camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/adversarial_belief: 93% pass rate on belief queries.
Of 153 scored trials (belief query kind), the model passed 93% and failed 7%.
3 additional trial(s) ended in ERROR (infra failures, cost cap, or cancellation) and are excluded from the pass rate above.
15 failures recorded; 11 survived verification (4 were sampling noise and are excluded from findings).
Diffuse weakness (below 90% but no outright flip) on: entity_state (pass rate 77% at the high end), foil_divergence (pass rate 77% at the high end).
In 9 of 11 classifiable belief failures the model reported where the object ACTUALLY was, not where the queried entity BELIEVED it was -- it collapsed their perspective into reality.
Notable failures
- record 4d1da1b4 expected: the north stairwellactual: lobby
- record f8e859ce expected: the break roomactual: south stairwell
- record d6eb58d8 expected: the libraryactual: lobby
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "utility closet" | belief | - | 0.000052 | 153/222 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "supply closet" | belief | - | 0.000060 | 175/256 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "north stairwell" | belief | - | 0.000104 | 161/479 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "mail room" | belief | - | 0.000128 | 154/602 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "cafeteria" | belief | - | 0.000144 | 176/675 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "north stairwell" | belief | - | 0.000144 | 209/669 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "observation deck" | belief | - | 0.000130 | 236/593 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "break room" | belief | - | 0.000104 | 205/467 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "lobby" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)verified-stable | belief | - | 0.000199 | 223/938 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "south stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)noise | belief | - | 0.000270 | 276/1283 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "south stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)verified-stable | belief | - | 0.000192 | 290/890 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "archive room" | belief | - | 0.000252 | 289/1190 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "lobby" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)verified-stable | belief | - | 0.000191 | 298/878 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "basement" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)verified-stable | belief | - | 0.000174 | 355/783 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "server room" | belief | - | 0.000195 | 341/890 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "break room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)verified-stable | belief | - | 0.000276 | 338/1296 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "security office" | belief | - | 0.000291 | 269/1389 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "library" | belief | - | 0.000229 | 329/1061 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "break room" | belief | - | 0.000457 | 222/2230 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "lobby" | belief | - | 0.000278 | 425/1284 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "library" | belief | - | 0.000318 | 317/1512 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "supply closet" | belief | - | 0.000302 | 433/1404 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "lobby" | belief | - | 0.000306 | 393/1431 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "wine cellar" | belief | - | 0.000354 | 395/1672 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕ERRORlength | belief | - | 0.000819 | 387/4000 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "utility closet" | belief | - | 0.000044 | 154/180 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "photo studio" | belief | - | 0.000046 | 165/191 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "mail room" | belief | - | 0.000088 | 177/397 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "front office" | belief | - | 0.000095 | 170/430 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "observation deck" | belief | - | 0.000109 | 153/507 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "north stairwell" | belief | - | 0.000099 | 171/453 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "break room" | belief | - | 0.000067 | 170/293 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "print room" | belief | - | 0.000091 | 158/415 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "basement" | belief | - | 0.000138 | 170/650 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "conference room" | belief | - | 0.000113 | 176/523 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "greenhouse" | belief | - | 0.000140 | 171/655 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "supply closet" | belief | - | 0.000119 | 155/556 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "reception area" | belief | - | 0.000068 | 184/293 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "basement" | belief | - | 0.000148 | 154/703 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "library" | belief | - | 0.000116 | 152/542 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "archive room" | belief | - | 0.000104 | 156/482 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "boiler room" | belief | - | 0.000147 | 171/691 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "south stairwell" | belief | - | 0.000188 | 167/900 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "observation deck" | belief | - | 0.000092 | 176/417 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "rooftop terrace" | belief | - | 0.000076 | 161/339 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "gym" | belief | - | 0.000153 | 155/727 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "break room" | belief | - | 0.000217 | 174/1039 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "photo studio" | belief | - | 0.000196 | 175/937 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "mail room" | belief | - | 0.000596 | 171/2937 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕ERRORlength | belief | - | 0.000808 | 164/4000 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "photo studio" | belief | - | 0.000059 | 155/256 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "conference room" | belief | - | 0.000082 | 177/367 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "atrium" | belief | - | 0.000110 | 171/509 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "atrium" | belief | - | 0.000103 | 166/475 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "courtyard" | belief | - | 0.000123 | 180/569 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "atrium" | belief | - | 0.000066 | 169/289 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "supply closet" | belief | - | 0.000227 | 168/1094 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "south stairwell" | belief | - | 0.000062 | 201/259 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "loading dock" | belief | - | 0.000095 | 189/429 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "loading dock" | belief | - | 0.000112 | 191/512 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "storage room" | belief | - | 0.000107 | 205/484 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "utility closet" | belief | - | 0.000053 | 196/215 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "lobby" | belief | - | 0.000056 | 207/230 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "atrium" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000218 | 184/1045 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "archive room" | belief | - | 0.000097 | 195/436 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "east wing" | belief | - | 0.000056 | 226/224 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "reception area" | belief | - | 0.000096 | 228/423 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "utility closet" | belief | - | 0.000134 | 198/620 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "storage room" | belief | - | 0.000081 | 224/351 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "wine cellar" | belief | - | 0.000063 | 240/255 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "loading dock" | belief | - | 0.000081 | 247/341 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "meditation room" | belief | - | 0.000078 | 243/328 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "greenhouse" | belief | - | 0.000143 | 244/652 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "photo studio" | belief | - | 0.000191 | 230/895 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "storage room" | belief | - | 0.000213 | 236/1008 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "south stairwell" | belief | - | 0.000046 | 157/189 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "wine cellar" | belief | - | 0.000070 | 171/306 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "conference room" | belief | - | 0.000081 | 183/361 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "loading dock" | belief | - | 0.000099 | 240/436 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "reception area" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000129 | 175/601 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "mail room" | belief | - | 0.000258 | 248/1230 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "storage room" | belief | - | 0.000180 | 357/810 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "observation deck" | belief | - | 0.000178 | 235/832 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "boiler room" | belief | - | 0.000274 | 233/1313 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "archive room" | belief | - | 0.000052 | 343/172 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "atrium" | belief | - | 0.000056 | 337/197 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "courtyard" | belief | - | 0.000110 | 342/464 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "photo studio" | belief | - | 0.000122 | 170/569 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "cafeteria" | belief | - | 0.000048 | 240/180 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "courtyard" | belief | - | 0.000090 | 431/344 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "server room" | belief | - | 0.000045 | 412/122 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "east wing" | belief | - | 0.000047 | 494/111 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "gym" | belief | - | 0.000063 | 427/208 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "garage" | belief | - | 0.000158 | 401/689 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "conference room" | belief | - | 0.000108 | 530/405 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "utility closet" | belief | - | 0.000113 | 512/435 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "lobby" | belief | - | 0.000205 | 528/894 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "security office" | belief | - | 0.000058 | 310/211 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "kitchen" | belief | - | 0.000257 | 480/1165 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "west wing" | belief | - | 0.000049 | 426/137 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "workshop" | belief | - | 0.000052 | 159/219 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "greenhouse" | belief | - | 0.000073 | 153/327 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "wine cellar" | belief | - | 0.000067 | 159/294 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "archive room" | belief | - | 0.000039 | 173/154 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "server room" | belief | - | 0.000033 | 159/124 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "wine cellar" | belief | - | 0.000183 | 159/875 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "kitchen" | belief | - | 0.000192 | 169/920 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "cafeteria" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)noise | belief | - | 0.000153 | 174/723 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "security office" | belief | - | 0.000050 | 156/209 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "wine cellar" | belief | - | 0.000044 | 168/177 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "workshop" | belief | - | 0.000167 | 175/792 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "courtyard" | belief | - | 0.000049 | 157/206 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "basement" | belief | - | 0.000091 | 161/415 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "observation deck" | belief | - | 0.000077 | 172/344 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "cafeteria" | belief | - | 0.000203 | 171/971 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "boiler room" | belief | - | 0.000051 | 162/213 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "print room" | belief | - | 0.000064 | 165/277 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "wine cellar" | belief | - | 0.000082 | 166/367 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "break room" | belief | - | 0.000115 | 178/528 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "north stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)noise | belief | - | 0.000156 | 176/734 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "rooftop terrace" | belief | - | 0.000111 | 164/512 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "conference room" | belief | - | 0.000083 | 168/371 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "east wing" | belief | - | 0.000064 | 177/278 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "west wing" | belief | - | 0.000115 | 172/530 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕ERRORlength | belief | - | 0.000808 | 162/4000 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "observation deck" | belief | - | 0.000057 | 159/246 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "server room" | belief | - | 0.000061 | 158/265 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "cafeteria" | belief | - | 0.000077 | 170/343 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "server room" | belief | - | 0.000102 | 170/466 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "atrium" | belief | - | 0.000077 | 170/341 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "kitchen" | belief | - | 0.000089 | 170/403 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "loading dock" | belief | - | 0.000167 | 171/792 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "loading dock" | belief | - | 0.000119 | 180/550 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "gym" | belief | - | 0.000100 | 165/460 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "greenhouse" | belief | - | 0.000038 | 163/147 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "archive room" | belief | - | 0.000093 | 173/424 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "reception" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000084 | 156/382 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "print room" | belief | - | 0.000077 | 163/346 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "boiler room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000162 | 173/766 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "kitchen" | belief | - | 0.000197 | 171/941 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "rooftop terrace" | belief | - | 0.000071 | 167/311 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "basement" | belief | - | 0.000083 | 170/372 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "library" | belief | - | 0.000111 | 180/510 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "rooftop terrace" | belief | - | 0.000122 | 163/571 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "front office" | belief | - | 0.000143 | 173/673 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "west wing" | belief | - | 0.000071 | 172/314 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "security office" | belief | - | 0.000081 | 175/362 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "photo studio" | belief | - | 0.000171 | 175/809 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "print room" | belief | - | 0.000067 | 164/296 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "garage" | belief | - | 0.000093 | 164/424 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "photo studio" | belief | - | 0.000059 | 174/252 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "print room" | belief | - | 0.000109 | 177/502 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "cafeteria" | belief | - | 0.000104 | 171/475 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "boiler room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000167 | 155/794 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "west wing" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000201 | 173/963 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "basement" | belief | - | 0.000112 | 219/505 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "loading dock" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)noise | belief | - | 0.000162 | 222/753 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "cafeteria" | belief | - | 0.000174 | 219/813 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "supply closet" | belief | - | 0.000294 | 204/1417 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "courtyard" | belief | - | 0.000217 | 225/1029 | full transcript → |