Trials · adversarial_belief
Every trial behind one square of the capability map: gpt-oss-120b on adversarial_belief.
42
0 errors
Trials in this cell
98%
41/42 scored
Pass rate
1
0 noise excluded
Real failures
$0.0116
Cell cost
Trials
| kind | verdict | realized dims | seeded traps | run | |
|---|---|---|---|---|---|
| belief | ✓PASSanswered "mail room" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "north stairwell" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "supply closet" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "cafeteria" | entity_state=2 temporal=0 coreference=0 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "utility closet" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "north stairwell" | entity_state=4 temporal=0 coreference=1 distractors=2 context_length=9 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "observation deck" | entity_state=4 temporal=0 coreference=1 distractors=2 context_length=9 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ?FAILanswered "workshop"unverified | entity_state=4 temporal=0 coreference=1 distractors=2 context_length=9 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "break room" | entity_state=4 temporal=0 coreference=1 distractors=2 context_length=9 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "security office" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "break room" | entity_state=4 temporal=0 coreference=1 distractors=2 context_length=9 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "archive room" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "break room" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "library" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "server room" | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "observation deck" | entity_state=6 temporal=0 coreference=0 distractors=2 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "storage room" | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "east wing" | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "library" | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "lobby" | entity_state=10 temporal=0 coreference=3 distractors=2 context_length=15 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "wine cellar" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "lobby" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "library" | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "south stairwell" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "supply closet" | entity_state=10 temporal=0 coreference=3 distractors=2 context_length=15 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "utility closet" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "observation deck" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "photo studio" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "mail room" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "north stairwell" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "front office" | entity_state=2 temporal=0.24 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "basement" | entity_state=2 temporal=0.24 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "greenhouse" | entity_state=2 temporal=0.24 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "conference room" | entity_state=2 temporal=0.24 coreference=0 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "break room" | entity_state=2 temporal=0.24 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "print room" | entity_state=2 temporal=0.48 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "basement" | entity_state=2 temporal=0.48 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "supply closet" | entity_state=2 temporal=0.48 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "reception area" | entity_state=2 temporal=0.48 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "garage" | entity_state=2 temporal=0.67 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "mail room" | entity_state=2 temporal=0.48 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "south stairwell" | entity_state=2 temporal=0.67 coreference=1 distractors=2 context_length=7 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyone | camp-full_map-gpt-oss-120b-001/adversarial_belief | transcript → |