Data to …… trials

Run camp-interactive-gemma-001

PASSED

What this run revealed, then every individual trial as evidence.

watch live →compare across models →
40
Trials
100%
40/40 scored
over trials
Pass rate
0
0%
Failures
$0.2322
Run cost

Run camp-interactive-gemma-001: passed essentially everything (100%) -- this test did not challenge the model.

Of 40 scored trials (interactive query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.

Trials40 trials
Per-trial table (40 trials -- prompt, reasoning, verdict, answer key)
modelverdictkinddifficultycost ($)tokens in/out
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00125911727/288full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "build_art_0", "args": {"artifact": ..."interactive-0.00123011564/246full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00125911750/280full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00146913726/322full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00125211678/279full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00193918812/192full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00204919435/353full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00231221915/402full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00233522040/437full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00202219238/326full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00297829030/249full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00296128855/252full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00295728819/250full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00312029862/447full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00294628724/247full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00371036201/299full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00375936692/299full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00373836487/299full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00375236632/296full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00393237663/552full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "build_art_0", "args": {"artifact": ..."interactive-0.00622159869/781full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00563554442/636full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00544153266/382full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00568654971/630full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00542953154/378full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00757874398/460full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00754174028/460full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_depth_flag_0", "args": {"flag":..."interactive-0.00864484924/505full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00786976329/786full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00754574054/464full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.010303101358/557full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.010912107316/601full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.010675103904/948full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.010647103624/948full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.010275101062/561full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.011832116500/606full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.011829116482/601full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.012516123134/675full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.012157118769/932full transcript →
google/gemma-3-27b-it✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.012480122944/617full transcript →