Data to …… trials

Run camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/adversarial_belief

90% PASS

What this run revealed, then every individual trial as evidence.

160
3 errors
Trials
93%
142/153 scored
over trials
Pass rate
15
11 stable / 4 noise
9%
Failures
$0.0229
Run cost

Run camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/adversarial_belief: 93% pass rate on belief queries.

Of 153 scored trials (belief query kind), the model passed 93% and failed 7%.

3 additional trial(s) ended in ERROR (infra failures, cost cap, or cancellation) and are excluded from the pass rate above.

15 failures recorded; 11 survived verification (4 were sampling noise and are excluded from findings).

Diffuse weakness (below 90% but no outright flip) on: entity_state (pass rate 77% at the high end), foil_divergence (pass rate 77% at the high end).

In 9 of 11 classifiable belief failures the model reported where the object ACTUALLY was, not where the queried entity BELIEVED it was -- it collapsed their perspective into reality.

Notable failures

  • record 4d1da1b4 — asked "Where does Opal believe the blue folder is? Answer with only the location name (or 'unknown' if they have no belief)."
    expected: the north stairwell
    actual: lobby

    the model reported the object's TRUE final location, not what the queried entity actually believed -- it collapsed belief into reality

  • record f8e859ce — asked "Where does Victor believe the faded wrench is? Answer with only the location name (or 'unknown' if they have no belief)."
    expected: the break room
    actual: south stairwell

    the model reported the object's TRUE final location, not what the queried entity actually believed -- it collapsed belief into reality

  • record d6eb58d8 — asked "Where does Willa believe the narrow folder is? Answer with only the location name (or 'unknown' if they have no belief)."
    expected: the library
    actual: lobby

    the model's answer matches no known shortcut -- an unclassified miss

Trials160 trials
Per-trial table (160 trials -- prompt, reasoning, verdict, answer key)
modelverdictkinddifficultycost ($)tokens in/out
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "utility closet"belief-0.000052153/222full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "supply closet"belief-0.000060175/256full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "north stairwell"belief-0.000104161/479full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "mail room"belief-0.000128154/602full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "cafeteria"belief-0.000144176/675full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "north stairwell"belief-0.000144209/669full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "observation deck"belief-0.000130236/593full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "break room"belief-0.000104205/467full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✕FAILanswered "lobby" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)verified-stablebelief-0.000199223/938full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✕FAILanswered "south stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)noisebelief-0.000270276/1283full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✕FAILanswered "south stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)verified-stablebelief-0.000192290/890full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "archive room"belief-0.000252289/1190full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✕FAILanswered "lobby" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)verified-stablebelief-0.000191298/878full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✕FAILanswered "basement" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)verified-stablebelief-0.000174355/783full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "server room"belief-0.000195341/890full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✕FAILanswered "break room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)verified-stablebelief-0.000276338/1296full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "security office"belief-0.000291269/1389full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "library"belief-0.000229329/1061full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "break room"belief-0.000457222/2230full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "lobby"belief-0.000278425/1284full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "library"belief-0.000318317/1512full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "supply closet"belief-0.000302433/1404full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "lobby"belief-0.000306393/1431full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "wine cellar"belief-0.000354395/1672full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✕ERRORlengthbelief-0.000819387/4000full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "utility closet"belief-0.000044154/180full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "photo studio"belief-0.000046165/191full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "mail room"belief-0.000088177/397full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "front office"belief-0.000095170/430full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "observation deck"belief-0.000109153/507full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "north stairwell"belief-0.000099171/453full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "break room"belief-0.000067170/293full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "print room"belief-0.000091158/415full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "basement"belief-0.000138170/650full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "conference room"belief-0.000113176/523full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "greenhouse"belief-0.000140171/655full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "supply closet"belief-0.000119155/556full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "reception area"belief-0.000068184/293full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "basement"belief-0.000148154/703full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "library"belief-0.000116152/542full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "archive room"belief-0.000104156/482full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "boiler room"belief-0.000147171/691full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "south stairwell"belief-0.000188167/900full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "observation deck"belief-0.000092176/417full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "rooftop terrace"belief-0.000076161/339full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "gym"belief-0.000153155/727full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "break room"belief-0.000217174/1039full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "photo studio"belief-0.000196175/937full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "mail room"belief-0.000596171/2937full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✕ERRORlengthbelief-0.000808164/4000full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "photo studio"belief-0.000059155/256full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "conference room"belief-0.000082177/367full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "atrium"belief-0.000110171/509full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "atrium"belief-0.000103166/475full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "courtyard"belief-0.000123180/569full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "atrium"belief-0.000066169/289full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "supply closet"belief-0.000227168/1094full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "south stairwell"belief-0.000062201/259full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "loading dock"belief-0.000095189/429full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "loading dock"belief-0.000112191/512full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "storage room"belief-0.000107205/484full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "utility closet"belief-0.000053196/215full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "lobby"belief-0.000056207/230full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✕FAILanswered "atrium" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stablebelief-0.000218184/1045full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "archive room"belief-0.000097195/436full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "east wing"belief-0.000056226/224full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "reception area"belief-0.000096228/423full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "utility closet"belief-0.000134198/620full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "storage room"belief-0.000081224/351full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "wine cellar"belief-0.000063240/255full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "loading dock"belief-0.000081247/341full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "meditation room"belief-0.000078243/328full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "greenhouse"belief-0.000143244/652full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "photo studio"belief-0.000191230/895full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "storage room"belief-0.000213236/1008full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "south stairwell"belief-0.000046157/189full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "wine cellar"belief-0.000070171/306full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "conference room"belief-0.000081183/361full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "loading dock"belief-0.000099240/436full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✕FAILanswered "reception area" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stablebelief-0.000129175/601full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "mail room"belief-0.000258248/1230full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "storage room"belief-0.000180357/810full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "observation deck"belief-0.000178235/832full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "boiler room"belief-0.000274233/1313full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "archive room"belief-0.000052343/172full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "atrium"belief-0.000056337/197full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "courtyard"belief-0.000110342/464full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "photo studio"belief-0.000122170/569full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "cafeteria"belief-0.000048240/180full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "courtyard"belief-0.000090431/344full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "server room"belief-0.000045412/122full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "east wing"belief-0.000047494/111full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "gym"belief-0.000063427/208full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "garage"belief-0.000158401/689full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "conference room"belief-0.000108530/405full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "utility closet"belief-0.000113512/435full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "lobby"belief-0.000205528/894full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "security office"belief-0.000058310/211full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "kitchen"belief-0.000257480/1165full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "west wing"belief-0.000049426/137full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "workshop"belief-0.000052159/219full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "greenhouse"belief-0.000073153/327full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "wine cellar"belief-0.000067159/294full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "archive room"belief-0.000039173/154full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "server room"belief-0.000033159/124full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "wine cellar"belief-0.000183159/875full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "kitchen"belief-0.000192169/920full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✕FAILanswered "cafeteria" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)noisebelief-0.000153174/723full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "security office"belief-0.000050156/209full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "wine cellar"belief-0.000044168/177full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "workshop"belief-0.000167175/792full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "courtyard"belief-0.000049157/206full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "basement"belief-0.000091161/415full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "observation deck"belief-0.000077172/344full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "cafeteria"belief-0.000203171/971full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "boiler room"belief-0.000051162/213full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "print room"belief-0.000064165/277full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "wine cellar"belief-0.000082166/367full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "break room"belief-0.000115178/528full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✕FAILanswered "north stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)noisebelief-0.000156176/734full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "rooftop terrace"belief-0.000111164/512full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "conference room"belief-0.000083168/371full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "east wing"belief-0.000064177/278full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "west wing"belief-0.000115172/530full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✕ERRORlengthbelief-0.000808162/4000full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "observation deck"belief-0.000057159/246full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "server room"belief-0.000061158/265full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "cafeteria"belief-0.000077170/343full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "server room"belief-0.000102170/466full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "atrium"belief-0.000077170/341full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "kitchen"belief-0.000089170/403full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "loading dock"belief-0.000167171/792full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "loading dock"belief-0.000119180/550full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "gym"belief-0.000100165/460full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "greenhouse"belief-0.000038163/147full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "archive room"belief-0.000093173/424full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✕FAILanswered "reception" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stablebelief-0.000084156/382full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "print room"belief-0.000077163/346full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✕FAILanswered "boiler room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stablebelief-0.000162173/766full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "kitchen"belief-0.000197171/941full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "rooftop terrace"belief-0.000071167/311full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "basement"belief-0.000083170/372full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "library"belief-0.000111180/510full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "rooftop terrace"belief-0.000122163/571full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "front office"belief-0.000143173/673full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "west wing"belief-0.000071172/314full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "security office"belief-0.000081175/362full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "photo studio"belief-0.000171175/809full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "print room"belief-0.000067164/296full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "garage"belief-0.000093164/424full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "photo studio"belief-0.000059174/252full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "print room"belief-0.000109177/502full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "cafeteria"belief-0.000104171/475full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✕FAILanswered "boiler room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stablebelief-0.000167155/794full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✕FAILanswered "west wing" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stablebelief-0.000201173/963full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "basement"belief-0.000112219/505full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✕FAILanswered "loading dock" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)noisebelief-0.000162222/753full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "cafeteria"belief-0.000174219/813full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "supply closet"belief-0.000294204/1417full transcript →
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B✓PASSanswered "courtyard"belief-0.000217225/1029full transcript →