Run camp-full_map-nano-002/adversarial_belief
86% PASSWhat this run revealed, then every individual trial as evidence.
160
Trials
90%
137/153 scored
over trials
Pass rate
23
16 stable / 7 noise
Failures
$0.0288
Run cost
Run camp-full_map-nano-002/adversarial_belief: 90% pass rate on belief queries.
Of 153 scored trials (belief query kind), the model passed 90% and failed 10%.
23 failures recorded; 16 survived verification (7 were sampling noise and are excluded from findings).
Diffuse weakness (below 90% but no outright flip) on: context_length (pass rate 80% at the high end), entity_state (pass rate 78% at the high end), foil_divergence (pass rate 78% at the high end).
In 14 of 16 classifiable belief failures the model reported where the object ACTUALLY was, not where the queried entity BELIEVED it was -- it collapsed their perspective into reality.
Notable failures
- record 9ca3f529 expected: the cafeteriaactual: kitchen
- record b7ade19e expected: the east wingactual: basement
- record 5ccc2a28 expected: the supply closetactual: workshop
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "utility closet" | belief | - | 0.000077 | 153/347 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "supply closet" | belief | - | 0.000079 | 175/350 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "north stairwell" | belief | - | 0.000112 | 161/521 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "north stairwell" | belief | - | 0.000117 | 209/532 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "break room" | belief | - | 0.000105 | 205/472 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "storage room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)noise | belief | - | 0.000175 | 236/814 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "kitchen" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000258 | 176/1245 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "mail room" | belief | - | 0.000280 | 154/1362 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "north stairwell" | belief | - | 0.000208 | 223/986 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "break room" | belief | - | 0.000186 | 290/857 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "security office" | belief | - | 0.000260 | 269/1231 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "library" | belief | - | 0.000251 | 298/1183 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "server room" | belief | - | 0.000155 | 341/688 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "break room" | belief | - | 0.000225 | 222/1070 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "basement" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)verified-stable | belief | - | 0.000198 | 355/900 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "library" | belief | - | 0.000248 | 317/1161 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "library" | belief | - | 0.000229 | 329/1061 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "lobby" | belief | - | 0.000221 | 393/1005 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "observation deck" | belief | - | 0.000408 | 276/1969 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "archive room" | belief | - | 0.000424 | 289/2049 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "workshop" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)verified-stable | belief | - | 0.000142 | 433/603 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "break room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)verified-stable | belief | - | 0.000312 | 338/1475 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "library" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)noise | belief | - | 0.000317 | 395/1487 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "lobby" | belief | - | 0.000295 | 425/1370 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "south stairwell" | belief | - | 0.000716 | 387/3482 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "utility closet" | belief | - | 0.000063 | 154/274 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "photo studio" | belief | - | 0.000065 | 165/282 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "north stairwell" | belief | - | 0.000084 | 171/378 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "mail room" | belief | - | 0.000092 | 177/415 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "front office" | belief | - | 0.000142 | 170/666 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "greenhouse" | belief | - | 0.000081 | 171/361 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "break room" | belief | - | 0.000116 | 170/535 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "print room" | belief | - | 0.000066 | 158/289 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "basement" | belief | - | 0.000141 | 170/662 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "observation deck" | belief | - | 0.000241 | 153/1168 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "reception area" | belief | - | 0.000068 | 184/293 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "conference room" | belief | - | 0.000192 | 176/917 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "supply closet" | belief | - | 0.000208 | 155/999 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "library" | belief | - | 0.000108 | 152/503 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "break room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000187 | 171/893 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "south stairwell" | belief | - | 0.000138 | 167/647 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "archive room" | belief | - | 0.000083 | 156/374 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "observation deck" | belief | - | 0.000104 | 176/475 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "boiler room" | belief | - | 0.000119 | 171/554 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "break room" | belief | - | 0.000164 | 174/775 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "basement" | belief | - | 0.000112 | 154/520 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "rooftop terrace" | belief | - | 0.000082 | 161/369 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "gym" | belief | - | 0.000233 | 155/1128 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "photo studio" | belief | - | 0.000348 | 175/1694 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "garage" | belief | - | 0.000607 | 164/2995 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "photo studio" | belief | - | 0.000053 | 155/224 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "supply closet" | belief | - | 0.000089 | 168/401 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "courtyard" | belief | - | 0.000111 | 180/508 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "conference room" | belief | - | 0.000121 | 177/559 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "atrium" | belief | - | 0.000139 | 166/654 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "mail room" | belief | - | 0.000086 | 184/383 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "atrium" | belief | - | 0.000068 | 169/296 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "atrium" | belief | - | 0.000171 | 171/811 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "loading dock" | belief | - | 0.000079 | 189/350 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "loading dock" | belief | - | 0.000061 | 191/255 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "lobby" | belief | - | 0.000044 | 207/170 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "storage room" | belief | - | 0.000104 | 205/469 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "utility closet" | belief | - | 0.000051 | 196/208 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "archive room" | belief | - | 0.000082 | 195/361 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "storage room" | belief | - | 0.000047 | 224/178 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "east wing" | belief | - | 0.000056 | 226/225 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "south stairwell" | belief | - | 0.000174 | 201/822 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "photo studio" | belief | - | 0.000059 | 230/235 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "utility closet" | belief | - | 0.000148 | 198/691 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "reception" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)noise | belief | - | 0.000095 | 228/418 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "wine cellar" | belief | - | 0.000057 | 240/225 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "storage room" | belief | - | 0.000095 | 236/417 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "loading dock" | belief | - | 0.000091 | 247/393 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "meditation room" | belief | - | 0.000181 | 243/845 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "greenhouse" | belief | - | 0.000162 | 244/751 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "south stairwell" | belief | - | 0.000066 | 157/293 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "conference room" | belief | - | 0.000077 | 183/337 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "loading dock" | belief | - | 0.000114 | 240/510 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "photo studio" | belief | - | 0.000127 | 170/590 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "supply closet" | belief | - | 0.000150 | 175/705 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "cafeteria" | belief | - | 0.000045 | 240/164 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "observation deck" | belief | - | 0.000056 | 235/220 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "courtyard" | belief | - | 0.000084 | 342/337 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "meditation room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000271 | 171/1313 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "mail room" | belief | - | 0.000218 | 248/1029 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "storage room" | belief | - | 0.000207 | 357/948 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "atrium" | belief | - | 0.000156 | 337/698 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "boiler room" | belief | - | 0.000043 | 233/156 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "server room" | belief | - | 0.000046 | 412/127 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "courtyard" | belief | - | 0.000140 | 431/591 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "security office" | belief | - | 0.000233 | 310/1088 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "west wing" | belief | - | 0.000121 | 426/498 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "archive room" | belief | - | 0.000054 | 343/183 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "east wing" | belief | - | 0.000096 | 494/356 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "utility closet" | belief | - | 0.000060 | 512/172 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "gym" | belief | - | 0.000228 | 427/1031 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "lobby" | belief | - | 0.000234 | 528/1040 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "garage" | belief | - | 0.000207 | 401/937 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "conference room" | belief | - | 0.000081 | 530/273 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "kitchen" | belief | - | 0.000189 | 480/824 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "wine cellar" | belief | - | 0.000029 | 159/106 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "workshop" | belief | - | 0.000058 | 159/248 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "greenhouse" | belief | - | 0.000072 | 153/321 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "break room" | belief | - | 0.000093 | 178/422 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "wine cellar" | belief | - | 0.000108 | 159/500 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "lobby" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000121 | 169/562 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "server room" | belief | - | 0.000048 | 159/202 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "archive room" | belief | - | 0.000128 | 173/596 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "wine cellar" | belief | - | 0.000065 | 168/283 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "loading dock" | belief | - | 0.000160 | 174/755 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "workshop" | belief | - | 0.000184 | 175/874 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "basement" | belief | - | 0.000100 | 161/459 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "cafeteria" | belief | - | 0.000155 | 171/734 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "observation deck" | belief | - | 0.000065 | 172/283 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "security office" | belief | - | 0.000186 | 156/890 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "courtyard" | belief | - | 0.000107 | 157/496 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "boiler room" | belief | - | 0.000067 | 162/296 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "wine cellar" | belief | - | 0.000053 | 166/226 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "rooftop terrace" | belief | - | 0.000125 | 176/581 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "print room" | belief | - | 0.000087 | 165/396 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "conference room" | belief | - | 0.000094 | 168/429 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "rooftop terrace" | belief | - | 0.000102 | 164/467 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "west wing" | belief | - | 0.000128 | 172/595 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "east wing" | belief | - | 0.000113 | 177/521 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "front office" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000381 | 162/1863 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "mail room" | belief | - | 0.000149 | 350/659 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "observation deck" | belief | - | 0.000217 | 324/1003 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "conference room" | belief | - | 0.000285 | 314/1346 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "photo studio" | belief | - | 0.000160 | 346/711 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "supply closet" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)noise | belief | - | 0.000200 | 307/923 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "print room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)verified-stable | belief | - | 0.000235 | 353/1088 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "east wing" | belief | - | 0.000273 | 314/1284 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "photo studio" | belief | - | 0.000274 | 332/1286 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "library" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)noise | belief | - | 0.000277 | 326/1302 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "south stairwell" | belief | - | 0.000248 | 336/1154 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "gym" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)verified-stable | belief | - | 0.000259 | 336/1211 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "basement" | belief | - | 0.000253 | 336/1179 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "atrium" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)noise | belief | - | 0.000276 | 315/1300 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "print room" | belief | - | 0.000313 | 313/1486 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "conference room" | belief | - | 0.000689 | 357/3355 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "front office" | belief | - | 0.000284 | 405/1319 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "meditation room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)verified-stable | belief | - | 0.000288 | 402/1338 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "server room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)verified-stable | belief | - | 0.000300 | 347/1411 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "garage" | belief | - | 0.000311 | 355/1466 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "lobby" | belief | - | 0.000303 | 417/1410 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "photo studio" | belief | - | 0.000285 | 370/1331 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "south stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)verified-stable | belief | - | 0.000246 | 392/1133 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "observation deck" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)verified-stable | belief | - | 0.000280 | 405/1297 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "loading dock" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)verified-stable | belief | - | 0.000202 | 373/915 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "boiler room" | belief | - | 0.000218 | 374/994 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "west wing" | belief | - | 0.000365 | 398/1727 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "boiler room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)noise | belief | - | 0.000550 | 395/2651 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "print room" | belief | - | 0.000365 | 397/1725 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✕FAILanswered "boiler room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)verified-stable | belief | - | 0.000238 | 406/1087 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "print room" | belief | - | 0.000565 | 388/2730 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "greenhouse" | belief | - | 0.000304 | 765/1328 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "basement" | belief | - | 0.000271 | 746/1171 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "loading dock" | belief | - | 0.000234 | 736/988 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "kitchen" | belief | - | 0.000325 | 752/1435 | full transcript → |
| nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B | ✓PASSanswered "east wing" | belief | - | 0.000351 | 750/1568 | full transcript → |