Run smoke-gemma-interactive-text2
PASSEDWhat this run revealed, then every individual trial as evidence.
3
Trials
100%
3/3 scored
Pass rate
0
Failures
$0.0053
Run cost
Run smoke-gemma-interactive-text2: passed essentially everything (100%) -- this test did not challenge the model.
Of 3 scored trials (interactive query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| google/gemma-3-27b-it | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..." | interactive | - | 0.001483 | 13850/325 | full transcript → |
| google/gemma-3-27b-it | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..." | interactive | - | 0.002531 | 23751/521 | full transcript → |
| google/gemma-3-27b-it | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..." | interactive | - | 0.001258 | 11751/275 | full transcript → |