Trials · order
Every trial behind one square of the capability map: Nemotron 3 Nano 30B on order.
160
2 errors
Trials in this cell
99%
156/158 scored
Pass rate
2
0 noise excluded
Real failures
$0.0229
Cell cost
Trials
| kind | verdict | realized dims | seeded traps | run | |
|---|---|---|---|---|---|
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=10 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=10 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=10 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=10 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=3 distractors=2 context_length=15 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=3 distractors=2 context_length=15 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=10 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=3 distractors=2 context_length=20 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=3 distractors=2 context_length=20 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.27 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.27 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.27 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.53 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.27 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.53 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.53 coreference=0 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.53 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.60 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.60 coreference=0 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.53 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.60 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=0 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✕ERRORlength | entity_state=2 temporal=0.27 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=9 context_length=13 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=9 context_length=13 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=16 context_length=20 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=9 context_length=13 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=9 context_length=13 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=20 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=20 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=20 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=9 context_length=13 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=20 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=23 context_length=27 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=23 context_length=27 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=23 context_length=27 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=23 context_length=27 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=30 context_length=34 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=23 context_length=27 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=30 context_length=34 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=30 context_length=34 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=30 context_length=34 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✕ERRORlength | entity_state=2 temporal=0 coreference=1 distractors=30 context_length=34 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=0 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=10 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=10 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=10 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=10 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=10 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=3 distractors=2 context_length=15 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=3 distractors=2 context_length=20 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=3 distractors=2 context_length=20 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=3 distractors=2 context_length=15 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.27 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.27 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.27 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.53 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.27 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.53 coreference=0 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.53 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.53 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.60 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.60 coreference=0 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.53 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.60 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=0 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.27 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=9 context_length=13 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=9 context_length=13 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=9 context_length=13 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=9 context_length=13 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=16 context_length=20 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=9 context_length=13 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=20 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=20 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=23 context_length=27 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=20 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=23 context_length=27 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=20 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=23 context_length=27 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=23 context_length=27 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=30 context_length=34 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=30 context_length=34 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=23 context_length=27 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=30 context_length=34 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✕FAILanswered "second"verified-stable | entity_state=2 temporal=0 coreference=1 distractors=30 context_length=34 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✕FAILanswered "second"verified-stable | entity_state=2 temporal=0 coreference=1 distractors=30 context_length=34 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=0 distractors=2 context_length=6 witness_gap=0 | camp-full_map-nano-002/order | transcript → |