Trials · adversarial_belief
Every trial behind one square of the capability map: Gemma 3 27B on adversarial_belief.
145
0 errors
Trials in this cell
43%
62/145 scored
Pass rate
83
0 noise excluded
Real failures
$0.0035
Cell cost
Trials
| kind | verdict | realized dims | seeded traps | run | |
|---|---|---|---|---|---|
| belief | ?FAILanswered "front office"unverified | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "print room"unverified | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "kitchen"unverified | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "workshop"unverified | entity_state=4 temporal=0 coreference=1 distractors=2 context_length=9 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "kitchen"unverified | entity_state=2 temporal=0 coreference=0 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "north stairwell" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "north stairwell" | entity_state=4 temporal=0 coreference=1 distractors=2 context_length=9 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "storage room"unverified | entity_state=4 temporal=0 coreference=1 distractors=2 context_length=9 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "south stairwell"unverified | entity_state=6 temporal=0 coreference=0 distractors=2 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "observation deck"unverified | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "library"unverified | entity_state=4 temporal=0 coreference=1 distractors=2 context_length=9 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "break room" | entity_state=4 temporal=0 coreference=1 distractors=2 context_length=9 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "archive room" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "break room"unverified | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "south stairwell"unverified | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "conference room"unverified | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "basement"unverified | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "greenhouse"unverified | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "meditation room"unverified | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "reception area"unverified | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "mail room"unverified | entity_state=10 temporal=0 coreference=3 distractors=2 context_length=15 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "wine cellar" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "lobby" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "workshop"unverified | entity_state=10 temporal=0 coreference=3 distractors=2 context_length=15 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "library"unverified | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "utility closet" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "front office" | entity_state=2 temporal=0.24 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "observation deck" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "archive room"unverified | entity_state=2 temporal=0.24 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "storage room"unverified | entity_state=2 temporal=0.24 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "print room"unverified | entity_state=2 temporal=0.24 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "print room" | entity_state=2 temporal=0.48 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "south stairwell"unverified | entity_state=2 temporal=0.24 coreference=0 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "break room"unverified | entity_state=2 temporal=0.48 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "supply closet" | entity_state=2 temporal=0.48 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "mail room" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "photo studio" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "workshop"unverified | entity_state=2 temporal=0.48 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "north stairwell" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "the garage" | entity_state=2 temporal=0.67 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "photo studio"unverified | entity_state=2 temporal=0.48 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "archive room"unverified | entity_state=2 temporal=0.71 coreference=0 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "library" | entity_state=2 temporal=0.67 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "boiler room"unverified | entity_state=2 temporal=0.67 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "archive room" | entity_state=2 temporal=0.67 coreference=3 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "photo studio"unverified | entity_state=2 temporal=0.67 coreference=3 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "break room" | entity_state=2 temporal=0.71 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "gym" | entity_state=2 temporal=0.71 coreference=0 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "archive room"unverified | entity_state=2 temporal=0.71 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "rooftop terrace" | entity_state=2 temporal=0.71 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "conference room" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "atrium" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=8 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "photo studio" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "courtyard" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "cafeteria"unverified | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "gym"unverified | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "atrium"unverified | entity_state=2 temporal=0 coreference=2 distractors=2 context_length=8 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "atrium" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=8 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "break room"unverified | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=8 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "loading dock" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=8 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "mail room"unverified | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=9 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "south stairwell" | entity_state=2 temporal=0 coreference=4 distractors=2 context_length=9 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "east wing"unverified | entity_state=2 temporal=0 coreference=2 distractors=2 context_length=9 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "utility closet" | entity_state=2 temporal=0 coreference=6 distractors=2 context_length=9 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "kitchen"unverified | entity_state=2 temporal=0 coreference=7 distractors=2 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "loading dock"unverified | entity_state=2 temporal=0 coreference=11 distractors=2 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "front office"unverified | entity_state=2 temporal=0 coreference=6 distractors=2 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "reception area"unverified | entity_state=2 temporal=0 coreference=10 distractors=2 context_length=9 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "south stairwell"unverified | entity_state=2 temporal=0 coreference=10 distractors=2 context_length=12 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "greenhouse" | entity_state=2 temporal=0 coreference=4 distractors=2 context_length=12 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "basement"unverified | entity_state=2 temporal=0 coreference=6 distractors=2 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "wine cellar" | entity_state=2 temporal=0 coreference=11 distractors=2 context_length=12 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "west wing"unverified | entity_state=2 temporal=0 coreference=7 distractors=2 context_length=12 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "print room"unverified | entity_state=2 temporal=0 coreference=9 distractors=2 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "meditation room" | entity_state=2 temporal=0 coreference=11 distractors=2 context_length=12 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "library"unverified | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "meditation room"unverified | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "wine cellar"unverified | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "unknown"unverified | entity_state=2 temporal=0 coreference=1 distractors=6 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "reception area"unverified | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "south stairwell" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "mail room" | entity_state=2 temporal=0 coreference=3 distractors=6 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "archive room"unverified | entity_state=2 temporal=0 coreference=1 distractors=6 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "unknown"unverified | entity_state=2 temporal=0 coreference=1 distractors=11 context_length=16 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "unknown"unverified | entity_state=2 temporal=0 coreference=1 distractors=6 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "library"unverified | entity_state=2 temporal=0 coreference=1 distractors=11 context_length=16 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "north stairwell"verified-stable | entity_state=2 temporal=0 coreference=1 distractors=6 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "garage" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=21 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "archive room" | entity_state=2 temporal=0 coreference=1 distractors=11 context_length=16 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "unknown"verified-stable | entity_state=2 temporal=0 coreference=3 distractors=11 context_length=16 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "server room" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=21 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "security office" | entity_state=2 temporal=0 coreference=1 distractors=11 context_length=16 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "basement"verified-stable | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=21 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "unknown"verified-stable | entity_state=2 temporal=0 coreference=1 distractors=20 context_length=25 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "west wing" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=21 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "gym" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=21 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "east wing" | entity_state=2 temporal=0 coreference=1 distractors=20 context_length=25 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "storage room"verified-stable | entity_state=2 temporal=0 coreference=3 distractors=20 context_length=25 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "cafeteria"verified-stable | entity_state=2 temporal=0 coreference=1 distractors=20 context_length=25 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "unknown"verified-stable | entity_state=2 temporal=0 coreference=1 distractors=20 context_length=25 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "workshop" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "lobby"verified-stable | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "security office"verified-stable | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "greenhouse" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "break room" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "wine cellar" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "archive room" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "print room"verified-stable | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "security office" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "server room" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "workshop" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "cafeteria"verified-stable | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "wine cellar" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "basement" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "front office"verified-stable | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "boiler room" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "library"verified-stable | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "boiler room"verified-stable | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "north stairwell"verified-stable | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "wine cellar" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "wine cellar"verified-stable | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "reception area"verified-stable | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "courtyard"verified-stable | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "conference room" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "east wing" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "garage" | entity_state=2 temporal=0 coreference=6 distractors=2 context_length=9 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "south stairwell" | entity_state=2 temporal=0 coreference=10 distractors=2 context_length=9 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "loading dock"verified-stable | entity_state=2 temporal=0 coreference=6 distractors=2 context_length=9 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "basement" | entity_state=2 temporal=0 coreference=4 distractors=2 context_length=9 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "photo studio"verified-stable | entity_state=2 temporal=0 coreference=4 distractors=2 context_length=9 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "kitchen"verified-stable | entity_state=2 temporal=0 coreference=10 distractors=2 context_length=10 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "basement"verified-stable | entity_state=2 temporal=0 coreference=4 distractors=2 context_length=10 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "reception area"verified-stable | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=10 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "atrium"verified-stable | entity_state=2 temporal=0 coreference=4 distractors=2 context_length=10 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "conference room" | entity_state=2 temporal=0 coreference=6 distractors=2 context_length=10 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "basement"verified-stable | entity_state=2 temporal=0 coreference=1 distractors=18 context_length=23 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "loading dock" | entity_state=2 temporal=0 coreference=1 distractors=18 context_length=23 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "conference room" | entity_state=2 temporal=0 coreference=1 distractors=18 context_length=23 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "wine cellar" | entity_state=2 temporal=0 coreference=1 distractors=18 context_length=23 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "unknown"verified-stable | entity_state=2 temporal=0 coreference=3 distractors=18 context_length=23 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "north stairwell"verified-stable | entity_state=2 temporal=0 coreference=1 distractors=19 context_length=24 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "unknown"verified-stable | entity_state=2 temporal=0 coreference=1 distractors=19 context_length=24 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "basement" | entity_state=2 temporal=0 coreference=1 distractors=19 context_length=24 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "server room"verified-stable | entity_state=2 temporal=0 coreference=1 distractors=19 context_length=24 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "print room"verified-stable | entity_state=2 temporal=0 coreference=1 distractors=19 context_length=24 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gemma-001/adversarial_belief | transcript → |