Trials · entity_state (high)
Every trial behind one square of the capability map: Nemotron 3 Nano 30B on entity_state (high).
378
25 errors
Trials in this cell
89%
305/342 scored
Pass rate
37
11 noise excluded
Real failures
$0.1247
Cell cost
Trials
| kind | verdict | realized dims | seeded traps | run | |
|---|---|---|---|---|---|
| state | ✓PASSanswered "boiler room" | entity_state=9 temporal=0 coreference=1 distractors=2 context_length=13 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "cafeteria" | entity_state=9 temporal=0 coreference=1 distractors=2 context_length=13 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "storage room" | entity_state=9 temporal=0 coreference=1 distractors=2 context_length=13 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "observation deck" | entity_state=9 temporal=0 coreference=1 distractors=2 context_length=13 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "boiler room" | entity_state=9 temporal=0 coreference=1 distractors=2 context_length=13 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "loading dock" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "east wing" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "cafeteria" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "mail room" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "south stairwell" | entity_state=16 temporal=0 coreference=3 distractors=2 context_length=20 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "archive room" | entity_state=23 temporal=0 coreference=3 distractors=2 context_length=27 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "west wing" | entity_state=23 temporal=0 coreference=1 distractors=2 context_length=27 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "atrium" | entity_state=23 temporal=0 coreference=1 distractors=2 context_length=27 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "mail room" | entity_state=23 temporal=0 coreference=1 distractors=2 context_length=27 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "print room" | entity_state=23 temporal=0 coreference=1 distractors=2 context_length=27 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "storage room" | entity_state=30 temporal=0 coreference=1 distractors=2 context_length=34 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "rooftop terrace" | entity_state=30 temporal=0 coreference=1 distractors=2 context_length=34 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "photo studio" | entity_state=30 temporal=0 coreference=1 distractors=2 context_length=34 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "photo studio" | entity_state=30 temporal=0 coreference=3 distractors=2 context_length=34 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "east wing" | entity_state=30 temporal=0 coreference=3 distractors=2 context_length=34 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "cafeteria" | entity_state=30 temporal=0 coreference=1 distractors=2 context_length=34 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "photo studio" | entity_state=30 temporal=0 coreference=3 distractors=2 context_length=34 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "print room" | entity_state=30 temporal=0 coreference=1 distractors=2 context_length=34 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "supply closet" | entity_state=30 temporal=0 coreference=1 distractors=2 context_length=34 | camp-state-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "south stairwell" | entity_state=30 temporal=0 coreference=1 distractors=2 context_length=34 | camp-state-nemotron-nano-001 | transcript → | |
| belief | ?FAILanswered "archive room"unverified | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=10 | camp-belief-nemotron-nano-001 | transcript → | |
| belief | ✓PASSanswered "reception area" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=10 | camp-belief-nemotron-nano-001 | transcript → | |
| belief | ✓PASSanswered "south stairwell" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=10 | camp-belief-nemotron-nano-001 | transcript → | |
| belief | ?FAILanswered "lobby"unverified | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=10 | camp-belief-nemotron-nano-001 | transcript → | |
| belief | ✓PASSanswered "west wing" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=10 | camp-belief-nemotron-nano-001 | transcript → | |
| belief | ✓PASSanswered "atrium" | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=12 | camp-belief-nemotron-nano-001 | transcript → | |
| belief | ✓PASSanswered "archive room" | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=12 | camp-belief-nemotron-nano-001 | transcript → | |
| belief | ✓PASSanswered "supply closet" | entity_state=8 temporal=0 coreference=3 distractors=2 context_length=12 | camp-belief-nemotron-nano-001 | transcript → | |
| belief | ✓PASSanswered "courtyard" | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=12 | camp-belief-nemotron-nano-001 | transcript → | |
| belief | ✓PASSanswered "east wing" | entity_state=8 temporal=0 coreference=3 distractors=2 context_length=12 | camp-belief-nemotron-nano-001 | transcript → | |
| belief | ✓PASSanswered "mail room" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=14 | camp-belief-nemotron-nano-001 | transcript → | |
| belief | ✓PASSanswered "front office" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=14 | camp-belief-nemotron-nano-001 | transcript → | |
| belief | ?FAILanswered "library"unverified | entity_state=10 temporal=0 coreference=3 distractors=2 context_length=14 | camp-belief-nemotron-nano-001 | transcript → | |
| belief | ✓PASSanswered "basement" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=14 | camp-belief-nemotron-nano-001 | transcript → | |
| belief | ✓PASSanswered "south stairwell" | entity_state=10 temporal=0 coreference=3 distractors=2 context_length=14 | camp-belief-nemotron-nano-001 | transcript → | |
| belief | ✓PASSanswered "security office" | entity_state=10 temporal=0.54 coreference=13 distractors=20 context_length=37 | camp-belief-nemotron-nano-001 | transcript → | |
| belief | ✓PASSanswered "greenhouse" | entity_state=10 temporal=0.54 coreference=16 distractors=20 context_length=37 | camp-belief-nemotron-nano-001 | transcript → | |
| belief | ✓PASSanswered "workshop" | entity_state=10 temporal=0.54 coreference=13 distractors=20 context_length=37 | camp-belief-nemotron-nano-001 | transcript → | |
| belief | ✓PASSanswered "utility closet" | entity_state=10 temporal=0.54 coreference=13 distractors=20 context_length=37 | camp-belief-nemotron-nano-001 | transcript → | |
| belief | ✓PASSanswered "front office" | entity_state=10 temporal=0.54 coreference=12 distractors=20 context_length=37 | camp-belief-nemotron-nano-001 | transcript → | |
| state | ✓PASSanswered "boiler room" | entity_state=9 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "cafeteria" | entity_state=9 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "observation deck" | entity_state=9 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "storage room" | entity_state=9 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "loading dock" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "boiler room" | entity_state=9 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "east wing" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "cafeteria" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "mail room" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "south stairwell" | entity_state=16 temporal=0 coreference=3 distractors=2 context_length=20 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "print room" | entity_state=23 temporal=0 coreference=1 distractors=2 context_length=27 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "atrium" | entity_state=23 temporal=0 coreference=1 distractors=2 context_length=27 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "archive room" | entity_state=23 temporal=0 coreference=3 distractors=2 context_length=27 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "mail room" | entity_state=23 temporal=0 coreference=1 distractors=2 context_length=27 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "rooftop terrace" | entity_state=30 temporal=0 coreference=1 distractors=2 context_length=34 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "photo studio" | entity_state=30 temporal=0 coreference=1 distractors=2 context_length=34 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "photo studio" | entity_state=30 temporal=0 coreference=3 distractors=2 context_length=34 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "west wing" | entity_state=23 temporal=0 coreference=1 distractors=2 context_length=27 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "east wing" | entity_state=30 temporal=0 coreference=3 distractors=2 context_length=34 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "storage room" | entity_state=30 temporal=0 coreference=1 distractors=2 context_length=34 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "supply closet" | entity_state=30 temporal=0 coreference=1 distractors=2 context_length=34 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "print room" | entity_state=30 temporal=0 coreference=1 distractors=2 context_length=34 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "cafeteria" | entity_state=30 temporal=0 coreference=1 distractors=2 context_length=34 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "photo studio" | entity_state=30 temporal=0 coreference=3 distractors=2 context_length=34 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| state | ✓PASSanswered "south stairwell" | entity_state=30 temporal=0 coreference=1 distractors=2 context_length=34 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/state | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=10 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=10 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=10 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=10 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=3 distractors=2 context_length=15 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=3 distractors=2 context_length=15 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=10 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=3 distractors=2 context_length=20 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=3 distractors=2 context_length=20 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| belief | ✓PASSanswered "break room" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=11 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✕FAILanswered "utility closet"noise | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=11 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "reception area" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=11 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✕FAILanswered "rooftop terrace"verified-stable | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "rooftop terrace" | entity_state=8 temporal=0 coreference=3 distractors=2 context_length=13 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "security office" | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✕FAILanswered "utility closet"verified-stable | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=11 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "reception area" | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "library" | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "garage" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=11 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✕FAILanswered "north stairwell"verified-stable | entity_state=10 temporal=0 coreference=3 distractors=2 context_length=15 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "west wing" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "server room" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✕FAILanswered "loading dock"verified-stable | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "basement" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "east wing" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=11 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "storage room" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=11 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "east wing" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=11 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "gym" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=11 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "library" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=11 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "basement" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=11 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "courtyard" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=11 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "storage room" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=11 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "server room" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=11 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "photo studio" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=11 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "workshop" | entity_state=6 temporal=0 coreference=0 distractors=2 context_length=11 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✕FAILanswered "cafeteria"noise | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=11 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "lobby" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=11 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "south stairwell" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=11 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "basement" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=11 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✕FAILanswered "print room"verified-stable | entity_state=10 temporal=0 coreference=3 distractors=2 context_length=15 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "observation deck" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "reception area" | entity_state=10 temporal=0 coreference=3 distractors=2 context_length=15 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "security office" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "kitchen" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "storage room" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "break room" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "archive room" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✕FAILanswered "storage room"verified-stable | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "garage" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "north stairwell" | entity_state=10 temporal=0 coreference=3 distractors=2 context_length=15 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✕FAILanswered "atrium"verified-stable | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "gym" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✓PASSanswered "east wing" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✕ERRORlength | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief | transcript → | |
| belief | ✕FAILanswered "south stairwell"noise | entity_state=6 temporal=0 coreference=0 distractors=2 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "south stairwell"verified-stable | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "archive room" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "lobby"verified-stable | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "basement"verified-stable | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "server room" | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/adversarial_belief | transcript → |
| belief | ✕FAILanswered "break room"verified-stable | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "security office" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=11 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "library" | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "lobby" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "library" | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "supply closet" | entity_state=10 temporal=0 coreference=3 distractors=2 context_length=15 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "lobby" | entity_state=10 temporal=0 coreference=3 distractors=2 context_length=15 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "wine cellar" | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/adversarial_belief | transcript → |
| belief | ✕ERRORlength | entity_state=10 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=1 | final_true_statelast_mentioned_locationlast_witnessed_by_anyonemost_frequent_locationquery_agent_own_last_move | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/adversarial_belief | transcript → |
| belief | ✓PASSanswered "conference room" | entity_state=5 temporal=0.15 coreference=3 distractors=8 context_length=26 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "storage room" | entity_state=5 temporal=0.15 coreference=2 distractors=8 context_length=26 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "utility closet" | entity_state=5 temporal=0.15 coreference=2 distractors=8 context_length=26 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✕ERRORlength | entity_state=5 temporal=0.15 coreference=2 distractors=8 context_length=26 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "basement" | entity_state=5 temporal=0.15 coreference=2 distractors=8 context_length=26 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✕ERRORlength | entity_state=5 temporal=0.15 coreference=3 distractors=8 context_length=26 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "storage room" | entity_state=5 temporal=0.15 coreference=2 distractors=8 context_length=26 witness_gap=1 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "rooftop terrace" | entity_state=9 temporal=0.27 coreference=6 distractors=13 context_length=46 witness_gap=3 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "observation deck" | entity_state=9 temporal=0.27 coreference=4 distractors=13 context_length=46 witness_gap=3 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "kitchen" | entity_state=9 temporal=0.27 coreference=6 distractors=13 context_length=46 witness_gap=3 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "garage" | entity_state=9 temporal=0.27 coreference=6 distractors=13 context_length=46 witness_gap=3 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "lobby" | entity_state=9 temporal=0.27 coreference=4 distractors=13 context_length=46 witness_gap=3 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "archive room" | entity_state=9 temporal=0.27 coreference=4 distractors=13 context_length=46 witness_gap=3 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "boiler room" | entity_state=9 temporal=0.27 coreference=4 distractors=13 context_length=46 witness_gap=3 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "front office" | entity_state=12 temporal=0.37 coreference=11 distractors=19 context_length=66 witness_gap=5 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "gym" | entity_state=12 temporal=0.37 coreference=11 distractors=19 context_length=66 witness_gap=5 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ?FAILanswered "workshop"unverified | entity_state=12 temporal=0.36 coreference=11 distractors=19 context_length=66 witness_gap=5 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "reception area" | entity_state=12 temporal=0.37 coreference=9 distractors=19 context_length=66 witness_gap=5 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "archive room" | entity_state=12 temporal=0.37 coreference=9 distractors=19 context_length=66 witness_gap=5 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "wine cellar" | entity_state=12 temporal=0.37 coreference=9 distractors=19 context_length=66 witness_gap=5 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "gym" | entity_state=12 temporal=0.37 coreference=11 distractors=19 context_length=66 witness_gap=5 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✕ERRORlength | entity_state=16 temporal=0.43 coreference=13 distractors=25 context_length=86 witness_gap=9 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "archive room" | entity_state=16 temporal=0.44 coreference=21 distractors=25 context_length=86 witness_gap=9 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ?FAILanswered "storage room"unverified | entity_state=16 temporal=0.43 coreference=13 distractors=25 context_length=86 witness_gap=9 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "greenhouse" | entity_state=16 temporal=0.43 coreference=16 distractors=25 context_length=86 witness_gap=9 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "break room" | entity_state=16 temporal=0.44 coreference=13 distractors=25 context_length=86 witness_gap=9 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ?FAILanswered "security office"unverified | entity_state=16 temporal=0.44 coreference=13 distractors=25 context_length=86 witness_gap=9 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ?FAILanswered "east wing"unverified | entity_state=16 temporal=0.44 coreference=12 distractors=25 context_length=86 witness_gap=9 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✕ERRORlength | entity_state=19 temporal=0.48 coreference=16 distractors=30 context_length=104 witness_gap=12 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✕ERRORlength | entity_state=19 temporal=0.48 coreference=16 distractors=30 context_length=104 witness_gap=12 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "courtyard" | entity_state=19 temporal=0.49 coreference=22 distractors=30 context_length=104 witness_gap=12 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✕ERRORlength | entity_state=19 temporal=0.49 coreference=16 distractors=30 context_length=104 witness_gap=12 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✕ERRORlength | entity_state=19 temporal=0.48 coreference=18 distractors=30 context_length=104 witness_gap=12 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "greenhouse" | entity_state=19 temporal=0.47 coreference=16 distractors=30 context_length=104 witness_gap=12 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "server room" | entity_state=19 temporal=0.49 coreference=16 distractors=30 context_length=104 witness_gap=12 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✕ERRORlength | entity_state=23 temporal=0.50 coreference=20 distractors=36 context_length=123 witness_gap=18 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✕ERRORlength | entity_state=23 temporal=0.51 coreference=24 distractors=36 context_length=123 witness_gap=18 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ?FAILanswered "south stairwell"unverified | entity_state=23 temporal=0.51 coreference=20 distractors=36 context_length=123 witness_gap=18 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ?FAILanswered "atrium"unverified | entity_state=23 temporal=0.50 coreference=20 distractors=36 context_length=123 witness_gap=18 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "workshop" | entity_state=23 temporal=0.50 coreference=24 distractors=36 context_length=123 witness_gap=18 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "archive room" | entity_state=23 temporal=0.50 coreference=21 distractors=36 context_length=123 witness_gap=18 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "conference room" | entity_state=23 temporal=0.51 coreference=24 distractors=36 context_length=123 witness_gap=18 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "reception area" | entity_state=25 temporal=0.51 coreference=37 distractors=40 context_length=136 witness_gap=22 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "supply closet" | entity_state=25 temporal=0.51 coreference=31 distractors=40 context_length=136 witness_gap=22 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✕ERRORlength | entity_state=25 temporal=0.51 coreference=27 distractors=40 context_length=136 witness_gap=22 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "server room" | entity_state=25 temporal=0.51 coreference=31 distractors=40 context_length=136 witness_gap=22 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✕ERRORlength | entity_state=25 temporal=0.51 coreference=25 distractors=40 context_length=136 witness_gap=22 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "wine cellar" | entity_state=25 temporal=0.52 coreference=27 distractors=40 context_length=136 witness_gap=22 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| belief | ✓PASSanswered "front office" | entity_state=25 temporal=0.51 coreference=25 distractors=40 context_length=136 witness_gap=22 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/breaking_point | transcript → | |
| state | ✓PASSanswered "boiler room" | entity_state=9 temporal=0 coreference=1 distractors=2 context_length=13 witness_gap=0 | camp-full_map-nano-002/state | transcript → |