Data to …… trials

Run camp-interactive-fault-gemma-001

PASSED

What this run revealed, then every individual trial as evidence.

watch live →compare across models →
40
Trials
100%
40/40 scored
over trials
Pass rate
0
0%
Failures
$0.2528
Run cost

Run camp-interactive-fault-gemma-001: passed essentially everything (100%) -- this test did not challenge the model.

Of 40 scored trials (interactive query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.

Trials40 trials
Per-trial table (40 trials -- prompt, reasoning, verdict, answer key)
modelverdictkinddifficultycost ($)tokens in/out
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00135713123/150full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00145913662/309full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00135713123/150full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00166715671/332full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00147013732/324full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00217421104/212full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00220821440/212full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00218721242/210full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00232322068/388full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00264925004/494full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00329132077/276full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00328832059/274full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00329132077/276full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00340332626/468full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00356434766/292full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00412040203/331full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00407739806/323full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00435541683/621full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00443843267/371full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00469445078/621full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00592357983/416full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00587457542/401full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00660463842/733full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00665064144/785full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00616259477/715full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00799678505/486full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00809079449/485full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00840281514/834full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00837281232/828full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00862884727/517full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.010971107920/596full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.011601114024/663full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.011356110528/1010full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.012055117150/1133full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.012256120628/644full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.012554123611/642full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.012511123196/637full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.013817134661/1169full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.013096127477/1162full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.012550123576/642full transcript →