Data to …… trials
I · Narrative

Tracks what a person believes from what they saw

Nemotron 3 Nano 30B

Finding:DEGRADES· grade A(research conclusion)

90% correct (521/578)

Tested up to chain length 25, scramble 1.0, pronoun pressure 8, distractor events 40, witness cutoff 0.9

Pass ratesingle rate, no difficulty dial
90%

521/578 scored trials passed · 95% interval 87%–92%

breaks ≤ 30%holds if interval reaches 95%0%50%100%
Why it slips

The model answers where the object really is, not where the person believes it is.

in 63% of failures (57 failures)

Example failure
Trial result: FAIL (one model answer)
FAIL
print room
Evidencewhat this finding rests on
  • Ground truthDeterministic simulation: the right answer is computed, not judged
  • StatisticsWilson 95% interval 87%–92%Grade A: strong evidence
  • Sample size578 scored trials in total29 errored trials excluded
  • Fresh-seed confirmationNot run yet
  • ReplicationNot run yet
Raw evidenceruns and trials

Back to the capability map →