Trials · distractors (high)
Every trial behind one square of the capability map: gpt-oss-120b on distractors (high).
45
0 errors
Trials in this cell
98%
44/45 scored
Pass rate
1
0 noise excluded
Real failures
$0.0104
Cell cost
Trials
| kind | verdict | realized dims | seeded traps | run | |
|---|---|---|---|---|---|
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=9 context_length=13 witness_gap=0 | camp-full_map-gpt-oss-120b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=9 context_length=13 witness_gap=0 | camp-full_map-gpt-oss-120b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=9 context_length=13 witness_gap=0 | camp-full_map-gpt-oss-120b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=9 context_length=13 witness_gap=0 | camp-full_map-gpt-oss-120b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=9 context_length=13 witness_gap=0 | camp-full_map-gpt-oss-120b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=20 witness_gap=0 | camp-full_map-gpt-oss-120b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=16 context_length=20 witness_gap=0 | camp-full_map-gpt-oss-120b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=20 witness_gap=0 | camp-full_map-gpt-oss-120b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=20 witness_gap=0 | camp-full_map-gpt-oss-120b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=23 context_length=27 witness_gap=0 | camp-full_map-gpt-oss-120b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=23 context_length=27 witness_gap=0 | camp-full_map-gpt-oss-120b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=20 witness_gap=0 | camp-full_map-gpt-oss-120b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=23 context_length=27 witness_gap=0 | camp-full_map-gpt-oss-120b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=23 context_length=27 witness_gap=0 | camp-full_map-gpt-oss-120b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=23 context_length=27 witness_gap=0 | camp-full_map-gpt-oss-120b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=30 context_length=34 witness_gap=0 | camp-full_map-gpt-oss-120b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=30 context_length=34 witness_gap=0 | camp-full_map-gpt-oss-120b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=30 context_length=34 witness_gap=0 | camp-full_map-gpt-oss-120b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=30 context_length=34 witness_gap=0 | camp-full_map-gpt-oss-120b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=30 context_length=34 witness_gap=0 | camp-full_map-gpt-oss-120b-001/order | transcript → | |
| belief | ✓PASSanswered "lobby" | entity_state=2 temporal=0 coreference=1 distractors=6 context_length=11 witness_gap=1 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "courtyard" | entity_state=2 temporal=0 coreference=1 distractors=6 context_length=11 witness_gap=1 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "photo studio" | entity_state=2 temporal=0 coreference=1 distractors=6 context_length=11 witness_gap=1 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "archive room" | entity_state=2 temporal=0 coreference=3 distractors=6 context_length=11 witness_gap=1 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "photo studio" | entity_state=2 temporal=0 coreference=3 distractors=11 context_length=16 witness_gap=1 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "photo studio" | entity_state=2 temporal=0 coreference=1 distractors=11 context_length=16 witness_gap=1 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "security office" | entity_state=2 temporal=0 coreference=3 distractors=6 context_length=11 witness_gap=1 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "north stairwell" | entity_state=2 temporal=0 coreference=1 distractors=11 context_length=16 witness_gap=1 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "basement" | entity_state=2 temporal=0 coreference=3 distractors=11 context_length=16 witness_gap=1 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "front office" | entity_state=2 temporal=0 coreference=1 distractors=11 context_length=16 witness_gap=1 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "reception area" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=21 witness_gap=1 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "rooftop terrace" | entity_state=2 temporal=0 coreference=3 distractors=16 context_length=21 witness_gap=1 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "storage room" | entity_state=2 temporal=0 coreference=3 distractors=16 context_length=21 witness_gap=1 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "south stairwell" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=21 witness_gap=1 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "east wing" | entity_state=2 temporal=0 coreference=1 distractors=20 context_length=25 witness_gap=1 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "archive room" | entity_state=2 temporal=0 coreference=3 distractors=16 context_length=21 witness_gap=1 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "meditation room" | entity_state=2 temporal=0 coreference=1 distractors=20 context_length=25 witness_gap=1 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "wine cellar" | entity_state=2 temporal=0 coreference=1 distractors=20 context_length=25 witness_gap=1 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "reception area" | entity_state=2 temporal=0 coreference=1 distractors=20 context_length=25 witness_gap=1 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "courtyard" | entity_state=2 temporal=0 coreference=1 distractors=20 context_length=25 witness_gap=1 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "courtyard" | entity_state=10 temporal=0.53 coreference=21 distractors=20 context_length=40 witness_gap=8 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "security office" | entity_state=10 temporal=0.52 coreference=13 distractors=20 context_length=40 witness_gap=8 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✕FAILanswered "unknown"verified-stable | entity_state=10 temporal=0.55 coreference=16 distractors=20 context_length=40 witness_gap=8 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "garage" | entity_state=10 temporal=0.52 coreference=13 distractors=20 context_length=40 witness_gap=8 | camp-full_map-gpt-oss-120b-001/belief | transcript → | |
| belief | ✓PASSanswered "greenhouse" | entity_state=10 temporal=0.54 coreference=13 distractors=20 context_length=40 witness_gap=8 | camp-full_map-gpt-oss-120b-001/belief | transcript → |