Run camp-full_map-gemma4qat-001/adversarial_belief
64% PASSWhat this run revealed, then every individual trial as evidence.
155
Trials
64%
99/155 scored
over trials
Pass rate
56
30 stable / 0 noise
Failures
$0.0034
Run cost
Run camp-full_map-gemma4qat-001/adversarial_belief: 64% pass rate on belief queries.
Of 155 scored trials (belief query kind), the model passed 64% and failed 36%.
56 failures recorded; 30 survived verification, 26 not yet verified.
In 56 of 56 classifiable belief failures the model reported where the object ACTUALLY was, not where the queried entity BELIEVED it was -- it collapsed their perspective into reality.
Notable failures
- record 18319872 expected: the cafeteriaactual: kitchen
- record c6efd2eb expected: the north stairwellactual: lobby
- record 9a541d69 expected: the break roomactual: library
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "kitchen" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000017 | 165/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "supply closet" | belief | - | 0.000018 | 169/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "mail room" | belief | - | 0.000016 | 152/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "utility closet" | belief | - | 0.000016 | 150/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "north stairwell" | belief | - | 0.000017 | 159/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "north stairwell" | belief | - | 0.000022 | 207/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "lobby" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000022 | 218/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "library" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000021 | 201/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "storage room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000023 | 220/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "wine cellar" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000022 | 213/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "observation deck" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000027 | 263/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "south stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000029 | 274/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "supply closet" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000029 | 276/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "library" | belief | - | 0.000030 | 291/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "south stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000029 | 281/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "east wing" | belief | - | 0.000036 | 352/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "break room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000034 | 331/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "greenhouse" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000035 | 339/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "library" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000038 | 375/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "workshop" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000044 | 431/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "reception area" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000033 | 316/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "meditation room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000032 | 307/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "break room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000042 | 414/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "mail room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000040 | 387/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "library" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000038 | 371/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "observation deck" | belief | - | 0.000016 | 151/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "photo studio" | belief | - | 0.000017 | 159/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "mail room" | belief | - | 0.000018 | 169/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "utility closet" | belief | - | 0.000016 | 152/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "front office" | belief | - | 0.000018 | 167/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "north stairwell" | belief | - | 0.000018 | 169/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "break room" | belief | - | 0.000018 | 168/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "basement" | belief | - | 0.000017 | 165/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "print room" | belief | - | 0.000016 | 153/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "basement" | belief | - | 0.000016 | 147/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "storage room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000017 | 163/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "conference room" | belief | - | 0.000018 | 172/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "greenhouse" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000016 | 151/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "garage" | belief | - | 0.000017 | 159/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "library" | belief | - | 0.000015 | 148/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "photo studio" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000019 | 176/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "boiler room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000017 | 165/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "break room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000018 | 169/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "archive room" | belief | - | 0.000016 | 152/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "archive room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000018 | 172/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "photo studio" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000018 | 166/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "archive room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000018 | 168/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "gym" | belief | - | 0.000016 | 152/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "north stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000018 | 172/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "rooftop terrace" | belief | - | 0.000017 | 153/5 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "photo studio" | belief | - | 0.000016 | 153/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "conference room" | belief | - | 0.000018 | 170/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "cafeteria" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000018 | 164/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "atrium" | belief | - | 0.000017 | 164/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "atrium" | belief | - | 0.000017 | 165/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "courtyard" | belief | - | 0.000018 | 167/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "mail room" | belief | - | 0.000019 | 181/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "storage room" | belief | - | 0.000020 | 193/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "loading dock" | belief | - | 0.000019 | 184/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "storage room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000019 | 181/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "atrium" | belief | - | 0.000018 | 167/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "south stairwell" | belief | - | 0.000021 | 196/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "utility closet" | belief | - | 0.000020 | 191/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "lobby" | belief | - | 0.000021 | 204/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "archive room" | belief | - | 0.000020 | 190/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "utility closet" | belief | - | 0.000020 | 191/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "reception area" | belief | - | 0.000024 | 224/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "storage room" | belief | - | 0.000023 | 217/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "east wing" | belief | - | 0.000023 | 220/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "loading dock" | belief | - | 0.000025 | 242/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "photo studio" | belief | - | 0.000023 | 219/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "storage room" | belief | - | 0.000024 | 234/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "wine cellar" | belief | - | 0.000024 | 231/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "greenhouse" | belief | - | 0.000024 | 235/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "meditation room" | belief | - | 0.000025 | 238/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "west wing" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000025 | 236/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "conference room" | belief | - | 0.000018 | 175/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "photo studio" | belief | - | 0.000018 | 168/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "wine cellar" | belief | - | 0.000018 | 168/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "south stairwell" | belief | - | 0.000016 | 152/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "reception area" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000018 | 170/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "mail room" | belief | - | 0.000025 | 243/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "library" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000033 | 319/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "cafeteria" | belief | - | 0.000025 | 236/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "wine cellar" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000033 | 324/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "archive room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000023 | 224/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "north stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000024 | 225/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "south stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000035 | 341/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "atrium" | belief | - | 0.000033 | 324/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "gym" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000042 | 410/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "basement" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000042 | 413/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "security office" | belief | - | 0.000032 | 306/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "basement" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000041 | 399/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "lobby" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000048 | 472/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "west wing" | belief | - | 0.000043 | 418/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "lobby" | belief | - | 0.000051 | 503/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "observation deck" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000042 | 406/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "storage room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000050 | 488/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "utility closet" | belief | - | 0.000049 | 485/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "greenhouse" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000049 | 478/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "wine cellar" | belief | - | 0.000016 | 153/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "greenhouse" | belief | - | 0.000016 | 151/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "kitchen" | belief | - | 0.000017 | 165/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "workshop" | belief | - | 0.000016 | 153/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "wine cellar" | belief | - | 0.000016 | 154/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "break room" | belief | - | 0.000018 | 168/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "workshop" | belief | - | 0.000017 | 167/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "archive room" | belief | - | 0.000018 | 167/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "server room" | belief | - | 0.000016 | 154/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "security office" | belief | - | 0.000016 | 154/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "cafeteria" | belief | - | 0.000018 | 167/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "cafeteria" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000018 | 171/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "wine cellar" | belief | - | 0.000017 | 161/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "observation deck" | belief | - | 0.000018 | 167/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "courtyard" | belief | - | 0.000016 | 153/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "kitchen" | belief | - | 0.000016 | 154/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "basement" | belief | - | 0.000017 | 159/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "boiler room" | belief | - | 0.000017 | 160/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "conference room" | belief | - | 0.000018 | 166/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "courtyard" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000017 | 163/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "wine cellar" | belief | - | 0.000016 | 155/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "reception area" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000017 | 156/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "rooftop terrace" | belief | - | 0.000019 | 170/5 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "west wing" | belief | - | 0.000017 | 164/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "east wing" | belief | - | 0.000018 | 171/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "security office" | belief | - | 0.000016 | 153/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "conference room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000018 | 166/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "cafeteria" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000017 | 162/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "observation deck" | belief | - | 0.000017 | 165/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "south stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000018 | 173/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "rooftop terrace" | belief | - | 0.000018 | 168/5 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "lobby" | belief | - | 0.000015 | 148/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "south stairwell" | belief | - | 0.000017 | 155/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "observation deck" | belief | - | 0.000017 | 156/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "mail room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000017 | 161/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "east wing" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000018 | 175/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "photo studio" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000017 | 165/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "boiler room" | belief | - | 0.000018 | 174/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "kitchen" | belief | - | 0.000018 | 169/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "rooftop terrace" | belief | - | 0.000018 | 163/5 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "library" | belief | - | 0.000018 | 170/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "cafeteria" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000017 | 163/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "front office" | belief | - | 0.000018 | 171/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "basement" | belief | - | 0.000018 | 166/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "rooftop terrace" | belief | - | 0.000018 | 163/5 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "rooftop terrace" | belief | - | 0.000017 | 156/5 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "meditation room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000018 | 170/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "courtyard" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000017 | 165/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "garage" | belief | - | 0.000016 | 157/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "print room" | belief | - | 0.000017 | 162/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "print room" | belief | - | 0.000018 | 172/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "photo studio" | belief | - | 0.000018 | 168/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "cafeteria" | belief | - | 0.000017 | 163/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "loading dock" | belief | - | 0.000016 | 152/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "west wing" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000018 | 170/3 | full transcript → |