Reliability
Gets the same task right every time (pass^k)
Nemotron 3 Super 120B
Finding:NOT TESTED(no evidence yet)
Not tested yet
Rate shown is pass^1 over repeats of the same tasks (X.consistency campaign); pass^k needs per-task grouping and is in results/consistency/<run_id>.json. Earlier hand measurement: Nano 63% single-try vs 17% on all 5 tries.
Not tested yet: there is no evidence about this capability for this model in the store.