Run smoke-gemma-code

PASSED

What this run revealed, then every individual trial as evidence.

watch live →compare across models →

Trials

100%

1/1 scored

Pass rate

Failures

$0.0001

Run cost

Run smoke-gemma-code: passed essentially everything (100%) -- this test did not challenge the model.

Of 1 scored trials (code query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.

Trials1 trial

Per-trial table (1 trials -- prompt, reasoning, verdict, answer key)

model	verdict	kind	difficulty	cost ($)	tokens in/out
google/gemma-3-27b-it	✓PASSanswered "ANSWER: 6"	code_trace	-	0.000074	144/198	full transcript →