Data to …… trials

Run camp-ef-tickets-gemma4qat-002

PASSED

What this run revealed, then every individual trial as evidence.

watch live →compare across models →
50
Trials
100%
50/50 scored
over trials
Pass rate
0
0%
Failures
$0.1455
Run cost

Run camp-ef-tickets-gemma4qat-002: every arm passes cleanly.

Arm A passes cleanly (100%, 10 trials).

Arm B passes cleanly (100%, 10 trials).

Arm C passes cleanly (100%, 10 trials).

Arm D passes cleanly (100%, 10 trials).

Arm X passes cleanly (100%, 10 trials).

Trials50 trials
Per-trial table (50 trials -- prompt, reasoning, verdict, answer key)
modelstageverdictkinddifficultycost ($)tokens in/out
gemma-4-31b-it-qat-w4a16-ctA✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00286027878/240full transcript →
gemma-4-31b-it-qat-w4a16-ctA✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00286327899/242full transcript →
gemma-4-31b-it-qat-w4a16-ctA✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00285627841/240full transcript →
gemma-4-31b-it-qat-w4a16-ctA✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00285727848/240full transcript →
gemma-4-31b-it-qat-w4a16-ctA✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00285327812/240full transcript →
gemma-4-31b-it-qat-w4a16-ctA✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00288028078/242full transcript →
gemma-4-31b-it-qat-w4a16-ctA✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00286327910/240full transcript →
gemma-4-31b-it-qat-w4a16-ctA✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00285027784/240full transcript →
gemma-4-31b-it-qat-w4a16-ctA✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00286727943/242full transcript →
gemma-4-31b-it-qat-w4a16-ctA✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00285227797/240full transcript →
gemma-4-31b-it-qat-w4a16-ctB✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00287127977/243full transcript →
gemma-4-31b-it-qat-w4a16-ctB✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00286327899/242full transcript →
gemma-4-31b-it-qat-w4a16-ctB✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00286227895/243full transcript →
gemma-4-31b-it-qat-w4a16-ctB✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00286427904/244full transcript →
gemma-4-31b-it-qat-w4a16-ctB✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00286027872/244full transcript →
gemma-4-31b-it-qat-w4a16-ctB✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00288028078/242full transcript →
gemma-4-31b-it-qat-w4a16-ctB✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00286927958/243full transcript →
gemma-4-31b-it-qat-w4a16-ctB✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00285427811/243full transcript →
gemma-4-31b-it-qat-w4a16-ctB✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00286827948/243full transcript →
gemma-4-31b-it-qat-w4a16-ctB✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00285527818/243full transcript →
gemma-4-31b-it-qat-w4a16-ctC✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00296928964/243full transcript →
gemma-4-31b-it-qat-w4a16-ctC✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00288728139/242full transcript →
gemma-4-31b-it-qat-w4a16-ctC✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00297829050/243full transcript →
gemma-4-31b-it-qat-w4a16-ctC✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00294328696/244full transcript →
gemma-4-31b-it-qat-w4a16-ctC✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00298129082/244full transcript →
gemma-4-31b-it-qat-w4a16-ctC✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00294728746/242full transcript →
gemma-4-31b-it-qat-w4a16-ctC✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00295828848/243full transcript →
gemma-4-31b-it-qat-w4a16-ctC✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00294828756/243full transcript →
gemma-4-31b-it-qat-w4a16-ctC✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00289328198/243full transcript →
gemma-4-31b-it-qat-w4a16-ctC✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00291928462/243full transcript →
gemma-4-31b-it-qat-w4a16-ctD✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00287428002/245full transcript →
gemma-4-31b-it-qat-w4a16-ctD✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00286427905/244full transcript →
gemma-4-31b-it-qat-w4a16-ctD✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00286627921/245full transcript →
gemma-4-31b-it-qat-w4a16-ctD✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00286627924/246full transcript →
gemma-4-31b-it-qat-w4a16-ctD✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00286327892/246full transcript →
gemma-4-31b-it-qat-w4a16-ctD✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00288228091/244full transcript →
gemma-4-31b-it-qat-w4a16-ctD✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00287227981/245full transcript →
gemma-4-31b-it-qat-w4a16-ctD✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00285527820/245full transcript →
gemma-4-31b-it-qat-w4a16-ctD✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00286927954/245full transcript →
gemma-4-31b-it-qat-w4a16-ctD✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00285627825/245full transcript →
gemma-4-31b-it-qat-w4a16-ctX✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00301929462/243full transcript →
gemma-4-31b-it-qat-w4a16-ctX✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00303329602/242full transcript →
gemma-4-31b-it-qat-w4a16-ctX✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00301129380/243full transcript →
gemma-4-31b-it-qat-w4a16-ctX✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00302329499/244full transcript →
gemma-4-31b-it-qat-w4a16-ctX✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00300929357/244full transcript →
gemma-4-31b-it-qat-w4a16-ctX✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00304029673/242full transcript →
gemma-4-31b-it-qat-w4a16-ctX✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00302329498/243full transcript →
gemma-4-31b-it-qat-w4a16-ctX✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00299229186/243full transcript →
gemma-4-31b-it-qat-w4a16-ctX✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00303829653/243full transcript →
gemma-4-31b-it-qat-w4a16-ctX✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00300129286/243full transcript →