Run camp-full_map-gemma-001
57% PASSWhat this run revealed, then every individual trial as evidence.
Full-map run camp-full_map-gemma-001: clean on order, breaking_point, weak province: state, belief, adversarial_belief.
State is a weak province: 56% pass rate across 45 trials.
(state) 20 failures recorded; all 20 survived verification.
Passes order cleanly (99%, 80 trials).
(order) 1 failures recorded; all 1 survived verification.
Belief is a weak province: 49% pass rate across 155 trials.
(belief) 79 failures recorded; 30 survived verification, 49 not yet verified.
(belief) In 63 of 79 classifiable belief failures the model reported where the object ACTUALLY was, not where the queried entity BELIEVED it was -- it collapsed their perspective into reality.
Adversarial_belief is a weak province: 43% pass rate across 145 trials.
(adversarial_belief) 83 failures recorded; 30 survived verification, 53 not yet verified.
(adversarial_belief) In 74 of 83 classifiable belief failures the model reported where the object ACTUALLY was, not where the queried entity BELIEVED it was -- it collapsed their perspective into reality.
breaking_point: escalation ray probed with 4 pass / 3 fail across 7 trials (failures not yet verified).
Notable failures
- record d55ca622 expected: the boiler roomactual: West wing
- record 9bc3cedf expected: the east wingactual: mail room
- record d73cbb84 expected: firstactual: **second**
Per-trial table
| model | stage | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|---|
| google/gemma-3-27b-it | state | ✓PASSanswered "Utility closet" | state | - | 0.000014 | 128/3 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "Courtyard" | state | - | 0.000013 | 125/3 | full transcript → |
| google/gemma-3-27b-it | state | ✕FAILanswered "West wing"verified-stable | state | - | 0.000027 | 256/3 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "Photo studio" | state | - | 0.000013 | 125/3 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "Storage room" | state | - | 0.000013 | 125/3 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "Courtyard" | state | - | 0.000013 | 122/3 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "Cafeteria" | state | - | 0.000026 | 247/4 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "Storage room" | state | - | 0.000025 | 244/3 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "Observation deck" | state | - | 0.000026 | 249/3 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "loading dock" | state | - | 0.000038 | 371/3 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "Boiler room" | state | - | 0.000026 | 249/4 | full transcript → |
| google/gemma-3-27b-it | state | ✕FAILanswered "mail room"verified-stable | state | - | 0.000039 | 376/3 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "Cafeteria" | state | - | 0.000039 | 380/4 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "mail room" | state | - | 0.000038 | 371/3 | full transcript → |
| google/gemma-3-27b-it | state | ✕FAILanswered "Server room"verified-stable | state | - | 0.000040 | 388/3 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "West wing" | state | - | 0.000050 | 493/3 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "The archive room." | state | - | 0.000051 | 492/5 | full transcript → |
| google/gemma-3-27b-it | state | ✕FAILanswered "Wine cellar"verified-stable | state | - | 0.000050 | 488/3 | full transcript → |
| google/gemma-3-27b-it | state | ✕FAILanswered "Security office"verified-stable | state | - | 0.000052 | 511/3 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "Print room" | state | - | 0.000051 | 504/3 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "Storage room" | state | - | 0.000064 | 627/3 | full transcript → |
| google/gemma-3-27b-it | state | ✕FAILanswered "atrium"verified-stable | state | - | 0.000063 | 617/3 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "rooftop terrace" | state | - | 0.000063 | 617/5 | full transcript → |
| google/gemma-3-27b-it | state | ✕FAILanswered "wine cellar"verified-stable | state | - | 0.000065 | 641/3 | full transcript → |
| google/gemma-3-27b-it | state | ✕FAILanswered "Archive room"verified-stable | state | - | 0.000064 | 630/3 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "Photo studio" | state | - | 0.000057 | 562/3 | full transcript → |
| google/gemma-3-27b-it | state | ✕FAILanswered "north stairwell"verified-stable | state | - | 0.000056 | 546/4 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "print room" | state | - | 0.000056 | 554/3 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "library" | state | - | 0.000056 | 555/2 | full transcript → |
| google/gemma-3-27b-it | state | ✕FAILanswered "Courtyard"verified-stable | state | - | 0.000057 | 559/3 | full transcript → |
| google/gemma-3-27b-it | state | ✕FAILanswered "Garage"verified-stable | state | - | 0.000060 | 589/2 | full transcript → |
| google/gemma-3-27b-it | state | ✕FAILanswered "photo studio"verified-stable | state | - | 0.000060 | 586/3 | full transcript → |
| google/gemma-3-27b-it | state | ✕FAILanswered "Kitchen"verified-stable | state | - | 0.000059 | 583/2 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "West wing" | state | - | 0.000060 | 591/3 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "mail room" | state | - | 0.000061 | 598/3 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "Workshop" | state | - | 0.000058 | 573/2 | full transcript → |
| google/gemma-3-27b-it | state | ✕FAILanswered "Storage room"verified-stable | state | - | 0.000058 | 569/3 | full transcript → |
| google/gemma-3-27b-it | state | ✕FAILanswered "library"verified-stable | state | - | 0.000058 | 576/2 | full transcript → |
| google/gemma-3-27b-it | state | ✕FAILanswered "server room"verified-stable | state | - | 0.000057 | 561/3 | full transcript → |
| google/gemma-3-27b-it | state | ✕FAILanswered "break room"verified-stable | state | - | 0.000057 | 561/3 | full transcript → |
| google/gemma-3-27b-it | state | ✕FAILanswered "Library"verified-stable | state | - | 0.000062 | 610/2 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "workshop" | state | - | 0.000062 | 616/2 | full transcript → |
| google/gemma-3-27b-it | state | ✓PASSanswered "Storage room" | state | - | 0.000064 | 627/3 | full transcript → |
| google/gemma-3-27b-it | state | ✕FAILanswered "boiler room"verified-stable | state | - | 0.000064 | 634/3 | full transcript → |
| google/gemma-3-27b-it | state | ✕FAILanswered "Gym"verified-stable | state | - | 0.000065 | 646/2 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Therefore, Bruno moving the box happened first." | order | - | 0.000033 | 149/59 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "8:00 is before 8:04, so Oscar's action happened first." | order | - | 0.000034 | 146/66 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Therefore, the answer is **first**." | order | - | 0.000035 | 142/69 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Answer: **first**" | order | - | 0.000048 | 213/90 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Therefore, Maya's action happened first." | order | - | 0.000032 | 152/56 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Answer: **first**" | order | - | 0.000056 | 219/113 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "8:00 is before 8:04, so Sana moving the tablet to the bre..." | order | - | 0.000035 | 144/69 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000053 | 216/103 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "8:00 is before 8:08, so Noor's action happened first." | order | - | 0.000043 | 218/69 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000047 | 299/56 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "The answer is **first**." | order | - | 0.000058 | 302/94 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000064 | 313/108 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "The answer is **first**." | order | - | 0.000052 | 298/74 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000051 | 311/66 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000066 | 391/91 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Answer: **first**" | order | - | 0.000069 | 394/98 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000108 | 217/289 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**first**" | order | - | 0.000072 | 469/83 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000077 | 472/99 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Therefore, Kira moving the box happened first." | order | - | 0.000064 | 461/60 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Therefore, the answer is **first**." | order | - | 0.000061 | 401/69 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000074 | 467/90 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Answer: **first**" | order | - | 0.000069 | 400/97 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000081 | 461/116 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Therefore, the answer is **first**." | order | - | 0.000075 | 404/115 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**first**" | order | - | 0.000034 | 143/64 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Answer: **first**" | order | - | 0.000039 | 146/81 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "The answer is **first**." | order | - | 0.000042 | 145/90 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "The answer is **first**." | order | - | 0.000041 | 140/91 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "8:00 is before 8:05, so moving the box happened first." | order | - | 0.000031 | 146/56 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Dana's action happened at 8:00, which is before Wyatt's a..." | order | - | 0.000038 | 146/79 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Therefore, the answer is **first**." | order | - | 0.000069 | 149/180 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000047 | 143/108 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000067 | 146/174 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000079 | 151/214 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000065 | 143/170 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000069 | 149/179 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "The answer is **first**." | order | - | 0.000078 | 147/210 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Therefore, the answer is **first**." | order | - | 0.000035 | 138/72 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "first" | order | - | 0.000015 | 141/3 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000068 | 142/179 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000068 | 150/176 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**first**" | order | - | 0.000060 | 148/151 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**first**" | order | - | 0.000064 | 149/164 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Therefore, the answer is **first**." | order | - | 0.000082 | 145/226 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Since 8:00 is earlier than 8:05, Sana moving the folder h..." | order | - | 0.000036 | 152/68 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000064 | 142/167 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000066 | 150/170 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000069 | 148/182 | full transcript → |
| google/gemma-3-27b-it | order | ✕FAILanswered "**second**"verified-stable | order | - | 0.000062 | 143/159 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "8:00 is before 8:04, so moving the folder happened first." | order | - | 0.000034 | 147/63 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "The answer is **first**." | order | - | 0.000037 | 142/76 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000050 | 263/79 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Therefore, the answer is **first**." | order | - | 0.000043 | 142/97 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Therefore, the answer is **first**." | order | - | 0.000041 | 280/45 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Therefore, the answer is **first**." | order | - | 0.000047 | 272/65 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000054 | 280/86 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "The answer is **first**." | order | - | 0.000039 | 148/79 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000075 | 274/160 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**first**" | order | - | 0.000046 | 143/105 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000063 | 386/83 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Answer: **first**" | order | - | 0.000071 | 401/102 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000067 | 394/92 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Answer: first" | order | - | 0.000065 | 381/89 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000082 | 506/106 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Answer: **first**" | order | - | 0.000081 | 513/98 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000091 | 543/122 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000078 | 524/85 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "8:00 is before 8:32, so Willa moving the box happened first." | order | - | 0.000087 | 653/71 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Answer: **first**" | order | - | 0.000088 | 627/84 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Answer: **first**" | order | - | 0.000077 | 526/83 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Answer: **first**" | order | - | 0.000093 | 651/93 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Therefore, the answer is **first**." | order | - | 0.000101 | 660/115 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000068 | 394/94 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Answer: first" | order | - | 0.000088 | 612/90 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "first" | order | - | 0.000016 | 147/3 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "8:00 is before 8:05, so Finn moving the folder to the uti..." | order | - | 0.000033 | 148/62 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000047 | 146/109 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "**Answer: first**" | order | - | 0.000036 | 152/71 | full transcript → |
| google/gemma-3-27b-it | order | ✓PASSanswered "Therefore, the answer is **first**." | order | - | 0.000039 | 144/81 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "photo studio"unverified | belief | - | 0.000016 | 148/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "garage" | belief | - | 0.000023 | 219/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "supply closet" | belief | - | 0.000016 | 151/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "workshop" | belief | - | 0.000017 | 159/2 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "reception area"unverified | belief | - | 0.000016 | 150/4 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "wine cellar"unverified | belief | - | 0.000017 | 162/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "kitchen" | belief | - | 0.000023 | 226/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "observation deck" | belief | - | 0.000024 | 232/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "basement" | belief | - | 0.000023 | 217/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "print room"unverified | belief | - | 0.000022 | 212/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "break room" | belief | - | 0.000026 | 251/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "reception area" | belief | - | 0.000029 | 281/4 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "break room" | belief | - | 0.000028 | 275/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "atrium"unverified | belief | - | 0.000029 | 283/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "boiler room" | belief | - | 0.000027 | 264/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "library" | belief | - | 0.000032 | 316/2 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "rooftop terrace"unverified | belief | - | 0.000037 | 359/5 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "kitchen"unverified | belief | - | 0.000036 | 352/2 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "garage"unverified | belief | - | 0.000036 | 354/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "cafeteria" | belief | - | 0.000039 | 374/4 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "reception area" | belief | - | 0.000035 | 342/4 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "rooftop terrace" | belief | - | 0.000036 | 349/5 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "courtyard"unverified | belief | - | 0.000036 | 353/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "mail room"unverified | belief | - | 0.000038 | 372/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "server room" | belief | - | 0.000037 | 364/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "photo studio" | belief | - | 0.000017 | 158/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "mail room"unverified | belief | - | 0.000017 | 162/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "loading dock" | belief | - | 0.000018 | 171/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "north stairwell" | belief | - | 0.000016 | 148/4 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "security office" | belief | - | 0.000016 | 146/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "photo studio" | belief | - | 0.000018 | 166/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "library" | belief | - | 0.000016 | 151/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "loading dock" | belief | - | 0.000016 | 148/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "rooftop terrace" | belief | - | 0.000018 | 163/5 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "east wing" | belief | - | 0.000017 | 161/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "rooftop terrace"unverified | belief | - | 0.000016 | 150/5 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "rooftop terrace" | belief | - | 0.000018 | 163/5 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "security office" | belief | - | 0.000018 | 168/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "greenhouse" | belief | - | 0.000017 | 161/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "storage room" | belief | - | 0.000016 | 149/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "reception area"unverified | belief | - | 0.000017 | 163/4 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "wine cellar"unverified | belief | - | 0.000016 | 148/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "workshop" | belief | - | 0.000016 | 152/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "front office" | belief | - | 0.000017 | 158/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "security office"unverified | belief | - | 0.000017 | 162/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "observation deck" | belief | - | 0.000017 | 156/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "utility closet" | belief | - | 0.000018 | 168/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "archive room"unverified | belief | - | 0.000018 | 168/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "south stairwell"unverified | belief | - | 0.000018 | 165/4 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "photo studio"unverified | belief | - | 0.000018 | 166/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "courtyard"unverified | belief | - | 0.000016 | 148/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "loading dock" | belief | - | 0.000018 | 167/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "courtyard"unverified | belief | - | 0.000017 | 158/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "rooftop terrace"unverified | belief | - | 0.000017 | 159/5 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "photo studio"unverified | belief | - | 0.000018 | 167/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "atrium" | belief | - | 0.000019 | 179/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "greenhouse"unverified | belief | - | 0.000019 | 178/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "library"unverified | belief | - | 0.000018 | 169/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "workshop" | belief | - | 0.000017 | 159/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "server room" | belief | - | 0.000017 | 165/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "photo studio"unverified | belief | - | 0.000019 | 182/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "basement"unverified | belief | - | 0.000018 | 171/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "meditation room"unverified | belief | - | 0.000020 | 189/4 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "south stairwell" | belief | - | 0.000021 | 197/4 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "security office"unverified | belief | - | 0.000023 | 222/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "supply closet"unverified | belief | - | 0.000022 | 214/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "east wing"unverified | belief | - | 0.000021 | 199/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "front office"unverified | belief | - | 0.000020 | 189/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "workshop" | belief | - | 0.000022 | 213/2 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "basement"unverified | belief | - | 0.000023 | 216/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "north stairwell" | belief | - | 0.000024 | 229/4 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "boiler room" | belief | - | 0.000024 | 232/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "archive room"unverified | belief | - | 0.000025 | 236/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "garage"unverified | belief | - | 0.000023 | 227/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "conference room" | belief | - | 0.000024 | 232/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "lobby"unverified | belief | - | 0.000024 | 233/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "server room" | belief | - | 0.000016 | 154/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "front office"unverified | belief | - | 0.000017 | 162/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "unknown"unverified | belief | - | 0.000017 | 166/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "south stairwell" | belief | - | 0.000017 | 163/4 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "basement"unverified | belief | - | 0.000017 | 159/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "unknown"unverified | belief | - | 0.000022 | 218/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "archive room" | belief | - | 0.000024 | 228/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "security office" | belief | - | 0.000023 | 221/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "east wing"unverified | belief | - | 0.000034 | 325/4 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "library"unverified | belief | - | 0.000031 | 300/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "photo studio" | belief | - | 0.000024 | 227/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "unknown"unverified | belief | - | 0.000042 | 408/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "loading dock"unverified | belief | - | 0.000043 | 418/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "unknown"unverified | belief | - | 0.000033 | 322/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "kitchen"unverified | belief | - | 0.000041 | 401/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "north stairwell" | belief | - | 0.000032 | 310/4 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "basement" | belief | - | 0.000032 | 306/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "meditation room" | belief | - | 0.000051 | 493/4 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "wine cellar" | belief | - | 0.000049 | 479/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "south stairwell" | belief | - | 0.000042 | 408/4 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "unknown"unverified | belief | - | 0.000051 | 504/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "storage room" | belief | - | 0.000043 | 417/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "reception area" | belief | - | 0.000049 | 475/4 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "unknown"unverified | belief | - | 0.000049 | 484/3 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "kitchen"unverified | belief | - | 0.000015 | 148/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "kitchen" | belief | - | 0.000017 | 165/2 | full transcript → |
| google/gemma-3-27b-it | belief | ?FAILanswered "workshop"unverified | belief | - | 0.000017 | 164/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "west wing"verified-stable | belief | - | 0.000017 | 165/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "break room"verified-stable | belief | - | 0.000017 | 162/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "photo studio"verified-stable | belief | - | 0.000017 | 160/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "library"verified-stable | belief | - | 0.000017 | 163/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "break room"verified-stable | belief | - | 0.000016 | 150/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "library" | belief | - | 0.000016 | 150/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "library"verified-stable | belief | - | 0.000017 | 164/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "workshop" | belief | - | 0.000017 | 166/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "courtyard"verified-stable | belief | - | 0.000016 | 149/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "library" | belief | - | 0.000015 | 145/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "gym"verified-stable | belief | - | 0.000017 | 163/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "security office"verified-stable | belief | - | 0.000016 | 149/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "mail room" | belief | - | 0.000016 | 147/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "boiler room" | belief | - | 0.000017 | 156/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "observation deck" | belief | - | 0.000016 | 147/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "storage room" | belief | - | 0.000016 | 146/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "wine cellar" | belief | - | 0.000018 | 167/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "loading dock"verified-stable | belief | - | 0.000016 | 149/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "greenhouse"verified-stable | belief | - | 0.000017 | 159/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "courtyard" | belief | - | 0.000016 | 148/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "utility closet" | belief | - | 0.000016 | 151/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "workshop"verified-stable | belief | - | 0.000015 | 146/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "archive room"verified-stable | belief | - | 0.000037 | 360/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "loading dock" | belief | - | 0.000036 | 353/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "server room"verified-stable | belief | - | 0.000034 | 333/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "west wing"verified-stable | belief | - | 0.000036 | 349/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "break room"verified-stable | belief | - | 0.000037 | 360/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "boiler room"verified-stable | belief | - | 0.000020 | 186/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "east wing" | belief | - | 0.000020 | 190/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "photo studio"verified-stable | belief | - | 0.000020 | 190/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "loading dock"verified-stable | belief | - | 0.000020 | 186/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "lobby"verified-stable | belief | - | 0.000019 | 186/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "workshop" | belief | - | 0.000020 | 190/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "courtyard"verified-stable | belief | - | 0.000020 | 188/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "loading dock"verified-stable | belief | - | 0.000020 | 192/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "library"verified-stable | belief | - | 0.000019 | 187/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "west wing" | belief | - | 0.000020 | 188/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "east wing" | belief | - | 0.000034 | 335/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "north stairwell" | belief | - | 0.000034 | 327/4 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "south stairwell" | belief | - | 0.000032 | 309/4 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "storage room"verified-stable | belief | - | 0.000032 | 315/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "unknown"verified-stable | belief | - | 0.000033 | 320/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "kitchen" | belief | - | 0.000036 | 355/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "unknown"verified-stable | belief | - | 0.000036 | 351/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "greenhouse" | belief | - | 0.000038 | 367/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "archive room" | belief | - | 0.000039 | 382/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "security office" | belief | - | 0.000040 | 389/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "unknown"verified-stable | belief | - | 0.000040 | 397/2 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "photo studio"verified-stable | belief | - | 0.000041 | 399/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✓PASSanswered "greenhouse" | belief | - | 0.000039 | 381/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "archive room"verified-stable | belief | - | 0.000040 | 392/3 | full transcript → |
| google/gemma-3-27b-it | belief | ✕FAILanswered "storage room"verified-stable | belief | - | 0.000041 | 403/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "front office" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000016 | 148/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "print room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000017 | 165/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "kitchen" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000015 | 146/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "workshop" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000021 | 203/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "kitchen" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000017 | 161/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "north stairwell" | belief | - | 0.000017 | 155/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "north stairwell" | belief | - | 0.000023 | 214/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "storage room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000023 | 216/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "south stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000028 | 270/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "observation deck" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000027 | 259/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "library" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000020 | 197/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "break room" | belief | - | 0.000022 | 209/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "archive room" | belief | - | 0.000028 | 272/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "break room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000034 | 327/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "south stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000029 | 277/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "conference room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000030 | 287/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "basement" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000036 | 348/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "greenhouse" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000034 | 335/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "meditation room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000031 | 303/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "reception area" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000032 | 312/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "mail room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000039 | 383/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "wine cellar" | belief | - | 0.000038 | 371/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "lobby" | belief | - | 0.000042 | 410/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "workshop" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000043 | 427/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "library" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000037 | 367/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "utility closet" | belief | - | 0.000016 | 148/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "front office" | belief | - | 0.000017 | 163/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "observation deck" | belief | - | 0.000016 | 147/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "archive room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000017 | 161/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "storage room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000017 | 159/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "print room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000017 | 164/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "print room" | belief | - | 0.000016 | 149/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "south stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000018 | 168/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "break room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000017 | 165/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "supply closet" | belief | - | 0.000016 | 147/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "mail room" | belief | - | 0.000017 | 165/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "photo studio" | belief | - | 0.000016 | 155/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "workshop" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000015 | 143/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "north stairwell" | belief | - | 0.000018 | 165/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "the garage" | belief | - | 0.000016 | 155/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "photo studio" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000018 | 172/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "archive room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000018 | 168/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "library" | belief | - | 0.000015 | 144/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "boiler room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000017 | 161/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "archive room" | belief | - | 0.000016 | 148/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "photo studio" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000017 | 162/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "break room" | belief | - | 0.000018 | 168/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "gym" | belief | - | 0.000015 | 148/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "archive room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000017 | 164/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "rooftop terrace" | belief | - | 0.000016 | 149/5 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "conference room" | belief | - | 0.000018 | 166/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "atrium" | belief | - | 0.000017 | 161/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "photo studio" | belief | - | 0.000016 | 149/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "courtyard" | belief | - | 0.000017 | 163/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "cafeteria" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000017 | 160/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "gym" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000017 | 160/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "atrium" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000019 | 177/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "atrium" | belief | - | 0.000017 | 163/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "break room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000019 | 180/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "loading dock" | belief | - | 0.000019 | 177/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "mail room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000020 | 189/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "south stairwell" | belief | - | 0.000020 | 192/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "east wing" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000020 | 187/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "utility closet" | belief | - | 0.000020 | 187/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "kitchen" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000022 | 213/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "loading dock" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000023 | 220/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "front office" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000021 | 200/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "reception area" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000020 | 186/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "south stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000024 | 230/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "greenhouse" | belief | - | 0.000024 | 231/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "basement" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000023 | 216/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "wine cellar" | belief | - | 0.000024 | 227/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "west wing" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000025 | 238/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "print room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000022 | 215/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "meditation room" | belief | - | 0.000025 | 234/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "library" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000017 | 164/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "meditation room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000018 | 164/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "wine cellar" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000018 | 171/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "unknown" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000024 | 232/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "reception area" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000018 | 166/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "south stairwell" | belief | - | 0.000016 | 148/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "mail room" | belief | - | 0.000025 | 239/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "archive room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000023 | 220/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "unknown" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000033 | 320/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "unknown" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000024 | 232/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ?FAILanswered "library" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000032 | 315/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "north stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000023 | 221/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "garage" | belief | - | 0.000040 | 395/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "archive room" | belief | - | 0.000035 | 337/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "unknown" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000033 | 320/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "server room" | belief | - | 0.000042 | 406/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "security office" | belief | - | 0.000031 | 302/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "basement" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000042 | 409/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "unknown" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000051 | 499/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "west wing" | belief | - | 0.000043 | 414/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "gym" | belief | - | 0.000041 | 402/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "east wing" | belief | - | 0.000048 | 468/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "storage room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000049 | 484/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "cafeteria" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000049 | 481/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "unknown" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000048 | 474/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "workshop" | belief | - | 0.000016 | 149/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "lobby" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000017 | 161/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "security office" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000016 | 150/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "greenhouse" | belief | - | 0.000016 | 147/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "break room" | belief | - | 0.000017 | 164/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "wine cellar" | belief | - | 0.000016 | 149/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "archive room" | belief | - | 0.000017 | 163/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "print room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000017 | 163/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "security office" | belief | - | 0.000016 | 150/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "server room" | belief | - | 0.000016 | 150/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "workshop" | belief | - | 0.000017 | 163/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "cafeteria" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000018 | 167/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "wine cellar" | belief | - | 0.000017 | 157/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "basement" | belief | - | 0.000016 | 155/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "front office" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000016 | 149/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "boiler room" | belief | - | 0.000017 | 156/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "library" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000017 | 163/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "boiler room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000016 | 150/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "north stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000018 | 166/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "wine cellar" | belief | - | 0.000016 | 151/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "wine cellar" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000017 | 160/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "reception area" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000016 | 152/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "courtyard" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000017 | 159/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "conference room" | belief | - | 0.000017 | 162/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "east wing" | belief | - | 0.000018 | 167/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "garage" | belief | - | 0.000020 | 191/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "south stairwell" | belief | - | 0.000021 | 193/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "loading dock" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000021 | 198/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "basement" | belief | - | 0.000019 | 176/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "photo studio" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000019 | 182/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "kitchen" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000021 | 199/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "basement" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000022 | 208/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "reception area" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000022 | 205/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "atrium" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000022 | 203/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "conference room" | belief | - | 0.000021 | 202/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "basement" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000045 | 445/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "loading dock" | belief | - | 0.000046 | 450/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "conference room" | belief | - | 0.000045 | 443/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "wine cellar" | belief | - | 0.000046 | 447/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "unknown" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000046 | 449/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "north stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000049 | 478/4 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "unknown" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000047 | 466/2 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✓PASSanswered "basement" | belief | - | 0.000047 | 459/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "server room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000048 | 467/3 | full transcript → |
| google/gemma-3-27b-it | adversarial_belief | ✕FAILanswered "print room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000046 | 451/3 | full transcript → |
| google/gemma-3-27b-it | breaking_point | ✓PASSanswered "west wing" | belief | - | 0.000051 | 501/3 | full transcript → |
| google/gemma-3-27b-it | breaking_point | ✓PASSanswered "mail room" | belief | - | 0.000049 | 478/3 | full transcript → |
| google/gemma-3-27b-it | breaking_point | ?FAILanswered "security office"unverified | belief | - | 0.000049 | 483/3 | full transcript → |
| google/gemma-3-27b-it | breaking_point | ✓PASSanswered "conference room" | belief | - | 0.000048 | 472/3 | full transcript → |
| google/gemma-3-27b-it | breaking_point | ?FAILanswered "rooftop terrace"unverified | belief | - | 0.000052 | 501/5 | full transcript → |
| google/gemma-3-27b-it | breaking_point | ✓PASSanswered "break room" | belief | - | 0.000051 | 503/3 | full transcript → |
| google/gemma-3-27b-it | breaking_point | ?FAILanswered "south stairwell"unverified | belief | - | 0.000050 | 492/4 | full transcript → |