Run camp-full_map-gemma4qat-001
67% PASSWhat this run revealed, then every individual trial as evidence.
Full-map run camp-full_map-gemma4qat-001: clean on state, order, breaking_point, weak province: belief, adversarial_belief.
Passes state cleanly (100%, 30 trials).
Passes order cleanly (99%, 80 trials).
(order) 1 failures recorded; all 1 survived verification.
Belief is a weak province: 59% pass rate across 155 trials.
(belief) 63 failures recorded; 30 survived verification, 33 not yet verified.
(belief) In 60 of 63 classifiable belief failures the model reported where the object ACTUALLY was, not where the queried entity BELIEVED it was -- it collapsed their perspective into reality.
Adversarial_belief is a weak province: 64% pass rate across 155 trials.
(adversarial_belief) 56 failures recorded; 30 survived verification, 26 not yet verified.
(adversarial_belief) In 56 of 56 classifiable belief failures the model reported where the object ACTUALLY was, not where the queried entity BELIEVED it was -- it collapsed their perspective into reality.
breaking_point: escalation ray probed with 18 pass / 38 fail across 56 trials (failures not yet verified).
Notable failures
- record 42b3e6bf expected: firstactual: Since neither event described in your question actually occurred as stated, the question cannot b...
- record 8c71f902 expected: the supply closetactual: garage
- record 3a2038d7 expected: the garageactual: front office
Per-trial table
| model | stage | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "utility closet" | state | - | 0.000014 | 132/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "Courtyard" | state | - | 0.000014 | 129/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "storage room" | state | - | 0.000014 | 129/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "Boiler room" | state | - | 0.000027 | 260/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "Courtyard" | state | - | 0.000014 | 126/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "photo studio" | state | - | 0.000014 | 129/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "Storage room" | state | - | 0.000026 | 248/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "observation deck" | state | - | 0.000026 | 253/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "Cafeteria" | state | - | 0.000026 | 251/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "Boiler room" | state | - | 0.000027 | 253/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "loading dock" | state | - | 0.000038 | 375/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "east wing" | state | - | 0.000039 | 380/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "mail room" | state | - | 0.000038 | 375/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "Cafeteria" | state | - | 0.000040 | 384/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "south stairwell" | state | - | 0.000040 | 392/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "archive room" | state | - | 0.000051 | 496/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "West wing" | state | - | 0.000051 | 497/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "atrium" | state | - | 0.000050 | 492/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "mail room" | state | - | 0.000052 | 515/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "print room" | state | - | 0.000052 | 508/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "storage room" | state | - | 0.000064 | 631/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "rooftop terrace" | state | - | 0.000064 | 621/5 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "photo studio" | state | - | 0.000063 | 621/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "Photo studio" | state | - | 0.000065 | 645/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "east wing" | state | - | 0.000064 | 634/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "supply closet" | state | - | 0.000064 | 630/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "cafeteria" | state | - | 0.000065 | 636/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "print room" | state | - | 0.000063 | 623/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "photo studio" | state | - | 0.000063 | 626/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | state | ✓PASSanswered "south stairwell" | state | - | 0.000063 | 619/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 156/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000015 | 148/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000023 | 220/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 153/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 150/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000015 | 146/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000031 | 303/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000023 | 223/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000023 | 222/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000023 | 221/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000022 | 217/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000032 | 317/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000031 | 306/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000032 | 315/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000031 | 302/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000040 | 395/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000041 | 404/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000041 | 408/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000040 | 398/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000041 | 405/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000048 | 473/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000048 | 476/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000047 | 465/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000048 | 471/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000047 | 465/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000015 | 144/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000015 | 147/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 150/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 150/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 149/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 153/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 150/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 150/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000015 | 147/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 153/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 151/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 155/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000015 | 146/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000015 | 147/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000015 | 146/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 154/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000015 | 142/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000015 | 145/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 153/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 154/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000015 | 147/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 152/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 152/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✕FAILanswered "Since neither event described in your question actually o..."verified-stable | order | - | 0.000044 | 149/97 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 156/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000015 | 147/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 152/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 151/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000015 | 146/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000015 | 146/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000027 | 267/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000029 | 284/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000028 | 276/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000028 | 278/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000029 | 284/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000040 | 390/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000041 | 405/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000040 | 398/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000040 | 398/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000039 | 385/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000052 | 510/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000052 | 517/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000055 | 547/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000054 | 530/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000053 | 528/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000066 | 657/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000064 | 631/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000067 | 664/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000066 | 655/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000062 | 616/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 151/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000015 | 148/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 152/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 150/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | order | ✓PASSanswered "first" | order | - | 0.000016 | 156/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "garage"unverified | belief | - | 0.000016 | 155/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "front office"unverified | belief | - | 0.000023 | 223/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "photo studio"unverified | belief | - | 0.000016 | 152/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "east wing" | belief | - | 0.000016 | 154/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "boiler room" | belief | - | 0.000018 | 166/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "workshop" | belief | - | 0.000017 | 163/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "print room"unverified | belief | - | 0.000023 | 216/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "reception area" | belief | - | 0.000030 | 285/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "north stairwell"unverified | belief | - | 0.000025 | 236/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "workshop"unverified | belief | - | 0.000026 | 255/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "gym"unverified | belief | - | 0.000024 | 230/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "server room"unverified | belief | - | 0.000023 | 221/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "garage" | belief | - | 0.000029 | 287/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "utility closet"unverified | belief | - | 0.000029 | 279/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "loading dock"unverified | belief | - | 0.000028 | 268/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "storage room"unverified | belief | - | 0.000033 | 320/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "basement"unverified | belief | - | 0.000036 | 356/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "north stairwell" | belief | - | 0.000038 | 363/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "reception area" | belief | - | 0.000036 | 346/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "library"unverified | belief | - | 0.000036 | 358/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "north stairwell"unverified | belief | - | 0.000039 | 378/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "north stairwell"unverified | belief | - | 0.000037 | 353/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "mail room"unverified | belief | - | 0.000039 | 376/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "loading dock"unverified | belief | - | 0.000037 | 357/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "mail room"unverified | belief | - | 0.000038 | 368/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "photo studio" | belief | - | 0.000017 | 162/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "unknown"unverified | belief | - | 0.000016 | 152/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "security office" | belief | - | 0.000016 | 150/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "loading dock" | belief | - | 0.000018 | 175/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "photo studio" | belief | - | 0.000018 | 170/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "mail room"unverified | belief | - | 0.000018 | 166/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "rooftop terrace" | belief | - | 0.000018 | 167/5 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "loading dock" | belief | - | 0.000016 | 152/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "library" | belief | - | 0.000016 | 155/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "unknown"unverified | belief | - | 0.000017 | 165/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "archive room" | belief | - | 0.000016 | 154/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "rooftop terrace" | belief | - | 0.000018 | 167/5 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "security office" | belief | - | 0.000018 | 172/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "front office" | belief | - | 0.000017 | 162/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "workshop" | belief | - | 0.000016 | 156/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "reception area"unverified | belief | - | 0.000018 | 167/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "basement"unverified | belief | - | 0.000017 | 165/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "cafeteria"unverified | belief | - | 0.000017 | 153/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "unknown"unverified | belief | - | 0.000016 | 152/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "observation deck" | belief | - | 0.000017 | 160/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "loading dock" | belief | - | 0.000018 | 172/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "photo studio"unverified | belief | - | 0.000018 | 170/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "security office"unverified | belief | - | 0.000018 | 166/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "utility closet" | belief | - | 0.000018 | 172/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "south stairwell"unverified | belief | - | 0.000018 | 169/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "break room" | belief | - | 0.000016 | 152/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "east wing" | belief | - | 0.000017 | 162/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "photo studio"unverified | belief | - | 0.000018 | 171/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "loading dock" | belief | - | 0.000018 | 171/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "atrium" | belief | - | 0.000019 | 183/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "cafeteria" | belief | - | 0.000017 | 163/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "workshop" | belief | - | 0.000017 | 163/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "supply closet" | belief | - | 0.000018 | 175/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "garage" | belief | - | 0.000018 | 173/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "server room" | belief | - | 0.000018 | 169/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "north stairwell" | belief | - | 0.000019 | 182/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "photo studio"unverified | belief | - | 0.000020 | 186/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "meditation room"unverified | belief | - | 0.000021 | 193/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "kitchen" | belief | - | 0.000022 | 218/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "conference room" | belief | - | 0.000020 | 193/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "supply closet" | belief | - | 0.000021 | 203/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "south stairwell" | belief | - | 0.000021 | 201/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "observation deck" | belief | - | 0.000024 | 226/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "west wing" | belief | - | 0.000023 | 220/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "workshop" | belief | - | 0.000022 | 217/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "archive room"unverified | belief | - | 0.000025 | 236/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "security office" | belief | - | 0.000025 | 240/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "greenhouse" | belief | - | 0.000024 | 231/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "north stairwell" | belief | - | 0.000024 | 233/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "conference room" | belief | - | 0.000025 | 236/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "lobby" | belief | - | 0.000017 | 163/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "security office" | belief | - | 0.000018 | 166/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "break room" | belief | - | 0.000018 | 170/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "server room" | belief | - | 0.000017 | 158/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "courtyard" | belief | - | 0.000025 | 237/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "south stairwell" | belief | - | 0.000018 | 167/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ?FAILanswered "mail room"unverified | belief | - | 0.000023 | 222/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "library"verified-stable | belief | - | 0.000031 | 304/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "boiler room"verified-stable | belief | - | 0.000024 | 232/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "security office" | belief | - | 0.000023 | 225/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "atrium"verified-stable | belief | - | 0.000024 | 231/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "east wing"verified-stable | belief | - | 0.000034 | 329/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "loading dock"verified-stable | belief | - | 0.000042 | 412/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "library"verified-stable | belief | - | 0.000033 | 326/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "greenhouse"verified-stable | belief | - | 0.000032 | 314/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "loading dock"verified-stable | belief | - | 0.000043 | 422/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "security office"verified-stable | belief | - | 0.000032 | 310/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "kitchen"verified-stable | belief | - | 0.000041 | 405/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "photo studio"verified-stable | belief | - | 0.000049 | 479/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "front office"verified-stable | belief | - | 0.000043 | 421/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "south stairwell" | belief | - | 0.000042 | 412/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "east wing" | belief | - | 0.000052 | 508/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "north stairwell"verified-stable | belief | - | 0.000051 | 497/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "archive room"verified-stable | belief | - | 0.000049 | 483/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "observation deck"verified-stable | belief | - | 0.000050 | 488/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "gym" | belief | - | 0.000017 | 168/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "kitchen" | belief | - | 0.000018 | 169/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "break room"verified-stable | belief | - | 0.000018 | 166/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "observation deck" | belief | - | 0.000018 | 169/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "photo studio"verified-stable | belief | - | 0.000017 | 164/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "south stairwell" | belief | - | 0.000016 | 152/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "library"verified-stable | belief | - | 0.000017 | 168/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "library"verified-stable | belief | - | 0.000017 | 167/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "library" | belief | - | 0.000016 | 154/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "break room"verified-stable | belief | - | 0.000016 | 154/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "workshop" | belief | - | 0.000018 | 170/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "print room" | belief | - | 0.000016 | 153/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "boiler room" | belief | - | 0.000017 | 160/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "library" | belief | - | 0.000016 | 149/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "east wing" | belief | - | 0.000016 | 153/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "reception area" | belief | - | 0.000018 | 167/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "observation deck" | belief | - | 0.000016 | 151/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "mail room" | belief | - | 0.000016 | 151/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "storage room" | belief | - | 0.000016 | 150/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "wine cellar" | belief | - | 0.000018 | 171/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "courtyard" | belief | - | 0.000016 | 152/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "utility closet" | belief | - | 0.000016 | 155/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "loading dock"verified-stable | belief | - | 0.000016 | 153/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "cafeteria" | belief | - | 0.000017 | 163/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "rooftop terrace" | belief | - | 0.000016 | 150/5 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "atrium" | belief | - | 0.000019 | 178/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "gym" | belief | - | 0.000018 | 178/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "front office" | belief | - | 0.000020 | 193/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "wine cellar" | belief | - | 0.000020 | 193/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "photo studio" | belief | - | 0.000019 | 178/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "cafeteria" | belief | - | 0.000019 | 178/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "kitchen" | belief | - | 0.000018 | 179/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "mail room" | belief | - | 0.000019 | 181/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "workshop" | belief | - | 0.000018 | 177/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "storage room"verified-stable | belief | - | 0.000020 | 187/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "greenhouse" | belief | - | 0.000020 | 192/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "security office"verified-stable | belief | - | 0.000019 | 177/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "north stairwell" | belief | - | 0.000021 | 197/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "east wing" | belief | - | 0.000020 | 192/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "loading dock" | belief | - | 0.000020 | 192/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "observation deck" | belief | - | 0.000016 | 154/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "storage room"verified-stable | belief | - | 0.000018 | 167/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "west wing" | belief | - | 0.000019 | 177/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "west wing"verified-stable | belief | - | 0.000018 | 169/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "cafeteria"verified-stable | belief | - | 0.000018 | 168/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "south stairwell" | belief | - | 0.000018 | 170/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "garage"verified-stable | belief | - | 0.000017 | 166/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "archive room"verified-stable | belief | - | 0.000016 | 154/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "east wing" | belief | - | 0.000017 | 165/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "lobby" | belief | - | 0.000015 | 148/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "wine cellar" | belief | - | 0.000016 | 152/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "reception area" | belief | - | 0.000018 | 168/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "library"verified-stable | belief | - | 0.000017 | 168/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✕FAILanswered "observation deck"verified-stable | belief | - | 0.000018 | 168/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | belief | ✓PASSanswered "kitchen" | belief | - | 0.000017 | 165/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "kitchen" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000017 | 165/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "supply closet" | belief | - | 0.000018 | 169/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "mail room" | belief | - | 0.000016 | 152/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "utility closet" | belief | - | 0.000016 | 150/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "north stairwell" | belief | - | 0.000017 | 159/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "north stairwell" | belief | - | 0.000022 | 207/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "lobby" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000022 | 218/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "library" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000021 | 201/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "storage room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000023 | 220/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "wine cellar" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000022 | 213/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "observation deck" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000027 | 263/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "south stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000029 | 274/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "supply closet" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000029 | 276/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "library" | belief | - | 0.000030 | 291/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "south stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000029 | 281/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "east wing" | belief | - | 0.000036 | 352/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "break room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000034 | 331/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "greenhouse" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000035 | 339/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "library" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000038 | 375/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "workshop" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000044 | 431/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "reception area" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000033 | 316/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "meditation room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000032 | 307/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "break room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000042 | 414/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "mail room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000040 | 387/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "library" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000038 | 371/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "observation deck" | belief | - | 0.000016 | 151/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "photo studio" | belief | - | 0.000017 | 159/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "mail room" | belief | - | 0.000018 | 169/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "utility closet" | belief | - | 0.000016 | 152/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "front office" | belief | - | 0.000018 | 167/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "north stairwell" | belief | - | 0.000018 | 169/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "break room" | belief | - | 0.000018 | 168/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "basement" | belief | - | 0.000017 | 165/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "print room" | belief | - | 0.000016 | 153/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "basement" | belief | - | 0.000016 | 147/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "storage room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000017 | 163/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "conference room" | belief | - | 0.000018 | 172/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "greenhouse" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000016 | 151/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "garage" | belief | - | 0.000017 | 159/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "library" | belief | - | 0.000015 | 148/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "photo studio" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000019 | 176/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "boiler room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000017 | 165/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "break room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000018 | 169/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "archive room" | belief | - | 0.000016 | 152/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "archive room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000018 | 172/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "photo studio" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000018 | 166/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ?FAILanswered "archive room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)unverified | belief | - | 0.000018 | 168/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "gym" | belief | - | 0.000016 | 152/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "north stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000018 | 172/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "rooftop terrace" | belief | - | 0.000017 | 153/5 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "photo studio" | belief | - | 0.000016 | 153/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "conference room" | belief | - | 0.000018 | 170/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "cafeteria" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000018 | 164/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "atrium" | belief | - | 0.000017 | 164/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "atrium" | belief | - | 0.000017 | 165/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "courtyard" | belief | - | 0.000018 | 167/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "mail room" | belief | - | 0.000019 | 181/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "storage room" | belief | - | 0.000020 | 193/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "loading dock" | belief | - | 0.000019 | 184/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "storage room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000019 | 181/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "atrium" | belief | - | 0.000018 | 167/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "south stairwell" | belief | - | 0.000021 | 196/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "utility closet" | belief | - | 0.000020 | 191/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "lobby" | belief | - | 0.000021 | 204/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "archive room" | belief | - | 0.000020 | 190/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "utility closet" | belief | - | 0.000020 | 191/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "reception area" | belief | - | 0.000024 | 224/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "storage room" | belief | - | 0.000023 | 217/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "east wing" | belief | - | 0.000023 | 220/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "loading dock" | belief | - | 0.000025 | 242/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "photo studio" | belief | - | 0.000023 | 219/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "storage room" | belief | - | 0.000024 | 234/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "wine cellar" | belief | - | 0.000024 | 231/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "greenhouse" | belief | - | 0.000024 | 235/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "meditation room" | belief | - | 0.000025 | 238/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "west wing" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000025 | 236/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "conference room" | belief | - | 0.000018 | 175/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "photo studio" | belief | - | 0.000018 | 168/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "wine cellar" | belief | - | 0.000018 | 168/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "south stairwell" | belief | - | 0.000016 | 152/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "reception area" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000018 | 170/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "mail room" | belief | - | 0.000025 | 243/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "library" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000033 | 319/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "cafeteria" | belief | - | 0.000025 | 236/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "wine cellar" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000033 | 324/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "archive room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000023 | 224/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "north stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000024 | 225/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "south stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000035 | 341/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "atrium" | belief | - | 0.000033 | 324/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "gym" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000042 | 410/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "basement" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000042 | 413/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "security office" | belief | - | 0.000032 | 306/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "basement" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000041 | 399/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "lobby" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000048 | 472/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "west wing" | belief | - | 0.000043 | 418/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "lobby" | belief | - | 0.000051 | 503/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "observation deck" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000042 | 406/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "storage room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000050 | 488/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "utility closet" | belief | - | 0.000049 | 485/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "greenhouse" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000049 | 478/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "wine cellar" | belief | - | 0.000016 | 153/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "greenhouse" | belief | - | 0.000016 | 151/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "kitchen" | belief | - | 0.000017 | 165/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "workshop" | belief | - | 0.000016 | 153/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "wine cellar" | belief | - | 0.000016 | 154/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "break room" | belief | - | 0.000018 | 168/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "workshop" | belief | - | 0.000017 | 167/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "archive room" | belief | - | 0.000018 | 167/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "server room" | belief | - | 0.000016 | 154/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "security office" | belief | - | 0.000016 | 154/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "cafeteria" | belief | - | 0.000018 | 167/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "cafeteria" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000018 | 171/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "wine cellar" | belief | - | 0.000017 | 161/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "observation deck" | belief | - | 0.000018 | 167/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "courtyard" | belief | - | 0.000016 | 153/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "kitchen" | belief | - | 0.000016 | 154/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "basement" | belief | - | 0.000017 | 159/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "boiler room" | belief | - | 0.000017 | 160/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "conference room" | belief | - | 0.000018 | 166/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "courtyard" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000017 | 163/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "wine cellar" | belief | - | 0.000016 | 155/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "reception area" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000017 | 156/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "rooftop terrace" | belief | - | 0.000019 | 170/5 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "west wing" | belief | - | 0.000017 | 164/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "east wing" | belief | - | 0.000018 | 171/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "security office" | belief | - | 0.000016 | 153/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "conference room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000018 | 166/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "cafeteria" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000017 | 162/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "observation deck" | belief | - | 0.000017 | 165/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "south stairwell" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000018 | 173/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "rooftop terrace" | belief | - | 0.000018 | 168/5 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "lobby" | belief | - | 0.000015 | 148/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "south stairwell" | belief | - | 0.000017 | 155/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "observation deck" | belief | - | 0.000017 | 156/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "mail room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000017 | 161/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "east wing" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000018 | 175/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "photo studio" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000017 | 165/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "boiler room" | belief | - | 0.000018 | 174/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "kitchen" | belief | - | 0.000018 | 169/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "rooftop terrace" | belief | - | 0.000018 | 163/5 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "library" | belief | - | 0.000018 | 170/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "cafeteria" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000017 | 163/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "front office" | belief | - | 0.000018 | 171/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "basement" | belief | - | 0.000018 | 166/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "rooftop terrace" | belief | - | 0.000018 | 163/5 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "rooftop terrace" | belief | - | 0.000017 | 156/5 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "meditation room" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000018 | 170/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "courtyard" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000017 | 165/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "garage" | belief | - | 0.000016 | 157/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "print room" | belief | - | 0.000017 | 162/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "print room" | belief | - | 0.000018 | 172/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "photo studio" | belief | - | 0.000018 | 168/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "cafeteria" | belief | - | 0.000017 | 163/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✓PASSanswered "loading dock" | belief | - | 0.000016 | 152/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | adversarial_belief | ✕FAILanswered "west wing" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone)verified-stable | belief | - | 0.000018 | 170/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ✓PASSanswered "cafeteria" | belief | - | 0.000023 | 220/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ✓PASSanswered "supply closet" | belief | - | 0.000024 | 231/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ✓PASSanswered "lobby" | belief | - | 0.000024 | 238/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ✓PASSanswered "rooftop terrace" | belief | - | 0.000025 | 238/5 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "reception area"unverified | belief | - | 0.000023 | 217/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ✓PASSanswered "photo studio" | belief | - | 0.000025 | 239/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "west wing"unverified | belief | - | 0.000025 | 237/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "front office"unverified | belief | - | 0.000054 | 530/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "boiler room"unverified | belief | - | 0.000053 | 525/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ✓PASSanswered "courtyard" | belief | - | 0.000054 | 534/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "unknown"unverified | belief | - | 0.000053 | 526/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ✓PASSanswered "security office" | belief | - | 0.000055 | 542/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "unknown"unverified | belief | - | 0.000054 | 531/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "observation deck"unverified | belief | - | 0.000053 | 519/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ✓PASSanswered "library" | belief | - | 0.000040 | 392/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ✓PASSanswered "boiler room" | belief | - | 0.000039 | 385/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ✓PASSanswered "workshop" | belief | - | 0.000040 | 391/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "cafeteria"unverified | belief | - | 0.000039 | 382/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "greenhouse"unverified | belief | - | 0.000040 | 391/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "server room"unverified | belief | - | 0.000040 | 386/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ✓PASSanswered "workshop" | belief | - | 0.000038 | 373/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "east wing"unverified | belief | - | 0.000048 | 471/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ✓PASSanswered "print room" | belief | - | 0.000049 | 480/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "conference room"unverified | belief | - | 0.000049 | 476/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "security office"unverified | belief | - | 0.000045 | 438/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "photo studio"unverified | belief | - | 0.000049 | 476/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "gym"unverified | belief | - | 0.000047 | 459/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "unknown"unverified | belief | - | 0.000046 | 453/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "loading dock"unverified | belief | - | 0.000043 | 420/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "unknown"unverified | belief | - | 0.000041 | 400/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ✓PASSanswered "storage room" | belief | - | 0.000042 | 415/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "utility closet"unverified | belief | - | 0.000043 | 420/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "kitchen"unverified | belief | - | 0.000043 | 419/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "loading dock"unverified | belief | - | 0.000044 | 430/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "print room"unverified | belief | - | 0.000044 | 429/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "unknown"unverified | belief | - | 0.000044 | 433/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "unknown"unverified | belief | - | 0.000041 | 405/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "boiler room"unverified | belief | - | 0.000042 | 411/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "unknown"unverified | belief | - | 0.000043 | 423/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "unknown"unverified | belief | - | 0.000042 | 410/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "courtyard"unverified | belief | - | 0.000043 | 420/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "greenhouse"unverified | belief | - | 0.000043 | 425/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ✓PASSanswered "storage room" | belief | - | 0.000025 | 244/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ✓PASSanswered "north stairwell" | belief | - | 0.000026 | 249/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ✓PASSanswered "break room" | belief | - | 0.000023 | 219/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "storage room"unverified | belief | - | 0.000024 | 234/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ✓PASSanswered "gym" | belief | - | 0.000024 | 235/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "server room"unverified | belief | - | 0.000024 | 230/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "unknown"unverified | belief | - | 0.000023 | 225/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "photo studio"unverified | belief | - | 0.000025 | 240/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "supply closet"unverified | belief | - | 0.000023 | 225/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ✓PASSanswered "reception area" | belief | - | 0.000023 | 221/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "reception area"unverified | belief | - | 0.000025 | 235/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "unknown"unverified | belief | - | 0.000023 | 228/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "unknown"unverified | belief | - | 0.000022 | 218/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | breaking_point | ?FAILanswered "server room"unverified | belief | - | 0.000025 | 238/3 | full transcript → |