Trials · order
Every trial behind one square of the capability map: Gemma 4 31B QAT on order.
209
0 errors
Trials in this cell
95%
199/209 scored
Pass rate
10
0 noise excluded
Real failures
$0.0088
Cell cost
Trials
| kind | verdict | realized dims | seeded traps | run | |
|---|---|---|---|---|---|
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=10 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=3 distractors=2 context_length=15 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=10 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=10 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=10 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=10 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=3 distractors=2 context_length=15 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=3 distractors=2 context_length=20 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=3 distractors=2 context_length=20 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.27 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.27 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.27 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.27 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.53 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.27 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.53 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.53 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.53 coreference=0 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.53 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.60 coreference=0 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.60 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=0 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✕FAILanswered "Since neither event described in your question actual..."verified-stable | entity_state=2 temporal=0.73 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.60 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=9 context_length=13 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=9 context_length=13 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=9 context_length=13 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=9 context_length=13 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=9 context_length=13 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=16 context_length=20 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=20 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=20 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=20 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=20 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=23 context_length=27 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=23 context_length=27 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=23 context_length=27 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=23 context_length=27 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=23 context_length=27 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=30 context_length=34 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=30 context_length=34 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=30 context_length=34 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=30 context_length=34 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=30 context_length=34 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=0 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-full_map-gemma4qat-001/order | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=8 temporal=0 coreference=3 distractors=2 context_length=12 witness_gap=0 | camp-premise-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=12 witness_gap=0 | camp-premise-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=8 temporal=0 coreference=1 distractors=2 context_length=12 witness_gap=0 | camp-premise-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=10 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=10 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=8 temporal=0.26 coreference=1 distractors=2 context_length=12 witness_gap=0 | camp-premise-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=8 temporal=0.23 coreference=1 distractors=2 context_length=12 witness_gap=0 | camp-premise-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=8 temporal=0.27 coreference=1 distractors=2 context_length=12 witness_gap=0 | camp-premise-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=1 distractors=2 context_length=10 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=10 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=6 temporal=0 coreference=3 distractors=2 context_length=10 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=8 temporal=0.29 coreference=1 distractors=2 context_length=12 witness_gap=0 | camp-premise-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=3 distractors=2 context_length=15 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=3 distractors=2 context_length=15 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=11 temporal=0 coreference=1 distractors=2 context_length=15 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=8 temporal=0.30 coreference=0 distractors=2 context_length=12 witness_gap=0 | camp-premise-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=8 temporal=0.29 coreference=1 distractors=2 context_length=12 witness_gap=0 | camp-premise-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=3 distractors=2 context_length=20 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=1 distractors=2 context_length=20 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=16 temporal=0 coreference=3 distractors=2 context_length=20 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=20 temporal=0 coreference=1 distractors=2 context_length=24 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.27 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.27 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.27 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.27 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.53 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.27 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.53 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.53 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.53 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.53 coreference=0 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.60 coreference=0 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.60 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=8 temporal=0.42 coreference=1 distractors=2 context_length=12 witness_gap=0 | camp-premise-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.73 coreference=0 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0.60 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ?FAILanswered "Since neither event described in your question actual..."unverified | entity_state=2 temporal=0.73 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ?FAILanswered "Marcus moving the tablet to the photo studio (8:04) h..."unverified | entity_state=8 temporal=0.41 coreference=1 distractors=2 context_length=12 witness_gap=0 | camp-premise-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=8 temporal=0.41 coreference=3 distractors=2 context_length=12 witness_gap=0 | camp-premise-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=9 context_length=13 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=9 context_length=13 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=9 context_length=13 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=9 context_length=13 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=9 context_length=13 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=16 context_length=20 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=20 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=8 temporal=0.52 coreference=3 distractors=2 context_length=12 witness_gap=0 | camp-premise-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=20 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=20 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=16 context_length=20 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=23 context_length=27 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=8 temporal=0.50 coreference=1 distractors=2 context_length=12 witness_gap=0 | camp-premise-order-gemma4qat-001 | transcript → | |
| order | ?FAILanswered "second"unverified | entity_state=8 temporal=0.50 coreference=1 distractors=2 context_length=12 witness_gap=0 | camp-premise-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=23 context_length=27 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=23 context_length=27 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=23 context_length=27 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=23 context_length=27 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=30 context_length=34 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=30 context_length=34 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=30 context_length=34 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=30 context_length=34 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=8 temporal=0.56 coreference=1 distractors=2 context_length=12 witness_gap=0 | camp-premise-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=8 temporal=0.59 coreference=1 distractors=2 context_length=12 witness_gap=0 | camp-premise-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=30 context_length=34 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=0 distractors=2 context_length=6 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=16 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=16 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=16 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ?FAILanswered "first"unverified | entity_state=8 temporal=0.58 coreference=1 distractors=2 context_length=12 witness_gap=0 | camp-premise-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=16 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=16 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=25 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=25 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=25 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=25 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=34 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=25 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=34 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=34 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=34 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=34 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=8 temporal=0.61 coreference=3 distractors=2 context_length=12 witness_gap=0 | camp-premise-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=8 temporal=0.58 coreference=3 distractors=2 context_length=12 witness_gap=0 | camp-premise-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=8 temporal=0.58 coreference=3 distractors=2 context_length=12 witness_gap=0 | camp-premise-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=44 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=3 distractors=2 context_length=44 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=44 witness_gap=0 | camp-order-gemma4qat-001 | transcript → | |
| order | ✓PASSanswered "first" | entity_state=2 temporal=0 coreference=1 distractors=2 context_length=44 witness_gap=0 | camp-order-gemma4qat-001 | transcript → |