Data to …… trials

Runs

Every campaign/pilot run recorded in this store, one row each (full_map runs are grouped under their parent run_id). Click a run_id for the full report and per-trial table.

Map a model →
157
Runs recorded
9,472
+292 checks
Trials
$10.2422
Total spend
6
Models covered
All runs157 runs
run_idmodelrecordspass ratetrendcoststartedstatus
camp-interactive-fault-gemma4qat-v3-001
Run camp-interactive-fault-gemma4qat-v3-001: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT3431/31 · 3 err100%$0.193721d agocomplete
camp-interactive-gemma4qat-v3-001
Run camp-interactive-gemma4qat-v3-001: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT3333/33100%$0.179821d agocomplete
camp-ef-tickets-gemma4qat-002
Run camp-ef-tickets-gemma4qat-002: every arm passes cleanly.
Gemma 4 31B QAT5050/50100%$0.145521d agocomplete
camp-ef-belief-gemma4qat-001
Run camp-ef-belief-gemma4qat-001, 4 arms: clean on A; below 97% on B, C, D.
Gemma 4 31B QAT12083/12069%$0.004821d agocomplete
camp-ef-repair-gemma4qat-001
Run camp-ef-repair-gemma4qat-001, 5 arms: clean on none; below 97% on A, B, C, D, X.
Gemma 4 31B QAT5014/48 · 2 err29%$0.429421d agocomplete
camp-ef-tickets-gemma4qat-001
Run camp-ef-tickets-gemma4qat-001, 5 arms: clean on none; below 97% on A, B, C, D, X.
Gemma 4 31B QAT508/5016%$0.036221d agocomplete
camp-ef-comments-gemma4qat-001
Run camp-ef-comments-gemma4qat-001: every arm passes cleanly.
Gemma 4 31B QAT4040/40100%$0.006221d agocomplete
camp-ef-tools-gemma4qat-001
Run camp-ef-tools-gemma4qat-001, 4 arms: clean on A, C; below 97% on B, D.
Gemma 4 31B QAT4037/4092%$0.009421d agocomplete
camp-repo-control-gemma4qat-003
Run camp-repo-control-gemma4qat-003: 22% pass rate on repo queries.
Gemma 4 31B QAT245/23 · 1 err22%$0.256421d agocomplete
camp-repo-navigate-gemma4qat-002
Run camp-repo-navigate-gemma4qat-002: 24% pass rate on repo queries.
Gemma 4 31B QAT184/17 · 1 err24%$0.180621d agocomplete
camp-repo-graph-gemma4qat-002
Run camp-repo-graph-gemma4qat-002, 2 arms: clean on none; below 97% on graph_off, graph_on.
Gemma 4 31B QAT307/27 · 3 err26%$0.308421d agocomplete
camp-repo-control-gemma4qat-002
Run camp-repo-control-gemma4qat-002: 42% pass rate on repo queries.
Gemma 4 31B QAT2410/2442%$0.255921d agocomplete
smoke-vi-gemma4qat-5
Run smoke-vi-gemma4qat-5: 0% pass rate on repo queries.
Gemma 4 31B QAT60/5 · 1 err0%$0.054221d agocomplete
camp-repo-navigate-gemma4qat-001
Run camp-repo-navigate-gemma4qat-001: 21% pass rate on repo queries.
Gemma 4 31B QAT183/14 · 4 err21%$0.165621d agocomplete
camp-repo-graph-gemma4qat-001
Run camp-repo-graph-gemma4qat-001, 2 arms: clean on none; below 97% on graph_off, graph_on.
Gemma 4 31B QAT163/12 · 4 err25%$0.146922d agocomplete
camp-repo-control-gemma4qat-001
Run camp-repo-control-gemma4qat-001: 35% pass rate on repo queries.
Gemma 4 31B QAT246/17 · 7 err35%$0.222922d agocomplete
smoke-vi-gemma4qat-4
Run smoke-vi-gemma4qat-4: 0% pass rate on repo queries.
Gemma 4 31B QAT60/5 · 1 err0%$0.045622d agocomplete
smoke-vi-gemma4qat-3
Run smoke-vi-gemma4qat-3: 0% pass rate on repo queries.
Gemma 4 31B QAT60/2 · 4 err0%$0.020222d agocomplete
smoke-vi-gemma4qat-2
Run smoke-vi-gemma4qat-2: 0% pass rate on repo queries.
Gemma 4 31B QAT60/2 · 4 err0%$0.039422d agocomplete
smoke-vi-gemma4qat
Run smoke-vi-gemma4qat: 33% pass rate on repo queries.
Gemma 4 31B QAT61/3 · 3 err33%$0.026322d agocomplete
camp-determinism-probe-gemma4qat-001
Run camp-determinism-probe-gemma4qat-001, 2 arms: clean on none; below 97% on parallel, serial.
Gemma 4 31B QAT309/3030%$0.018825d agocomplete
camp-code-repair-confirm-gemma4qat-postfix-001
Run camp-code-repair-confirm-gemma4qat-postfix-001, 1 arms: clean on none; below 97% on trace.
Gemma 4 31B QAT145/1436%$0.007425d agocomplete
camp-code-repair-kinds-gemma4qat-postfix-001
Run camp-code-repair-kinds-gemma4qat-postfix-001: every arm passes cleanly.
Gemma 4 31B QAT53/560%$0.002225d agocomplete
camp-code-pairtrace-xcheck-gemma4qat-001
Run camp-code-pairtrace-xcheck-gemma4qat-001: 50% pass rate on code queries.
Gemma 4 31B QAT483/486%$0.016225d agocomplete
camp-code-repair-confirm-gemma4qat-001
Run camp-code-repair-confirm-gemma4qat-001, 1 arms: clean on none; below 97% on trace.
Gemma 4 31B QAT4416/39 · 5 err41%$0.015325d agocomplete
camp-code-repair-kinds-gemma4qat-002
Run camp-code-repair-kinds-gemma4qat-002, 1 arms: clean on none; below 97% on trace.
Gemma 4 31B QAT114/1136%$0.003325d agocomplete
camp-code-repair-kinds-gemma4qat-001
Run camp-code-repair-kinds-gemma4qat-001, 1 arms: clean on none; below 97% on trace.
Gemma 4 31B QAT144/1429%$0.004425d agocomplete
camp-code-repair-gemma4qat-001
Run camp-code-repair-gemma4qat-001, 1 arms: clean on none; below 97% on trace.
Gemma 4 31B QAT114/1136%$0.004625d agocomplete
smoke-v-gemma4qat
Run smoke-v-gemma4qat, 1 arms: clean on none; below 97% on trace.
Gemma 4 31B QAT21/250%$0.000725d agocomplete
camp-code-hunt-gemma4qat-001
Run camp-code-hunt-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT183183/183100%$0.043326d agocomplete
camp-code-gotcha-gemma4qat-002
Run camp-code-gotcha-gemma4qat-002: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT3333/33100%$0.008126d agocomplete
camp-code-depth-gemma4qat-002
Run camp-code-depth-gemma4qat-002: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT3333/33100%$0.007326d agocomplete
camp-code-stack-gemma4qat-002
Run camp-code-stack-gemma4qat-002: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT3333/33100%$0.009126d agocomplete
camp-code-gotcha-gemma4qat-001
Run camp-code-gotcha-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT3333/33100%$0.007726d agocomplete
camp-code-depth-gemma4qat-001
Run camp-code-depth-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT3333/33100%$0.007326d agocomplete
camp-code-stack-gemma4qat-001
Run camp-code-stack-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT3333/33100%$0.008726d agocomplete
smoke-code-r2-gemma4qat
Run smoke-code-r2-gemma4qat: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT33/3100%$0.000926d agocomplete
camp-full_map-gpt-oss-120b-001
Full-map run camp-full_map-gpt-oss-120b-001: clean on state, order, adversarial_belief, weak province: belief.
gpt-oss-120b312304/311 · 1 err98%$0.074227d agocomplete
camp-consistency-gemma4qat-002
Run camp-consistency-gemma4qat-002: 62% pass rate on tool queries.
Gemma 4 31B QAT4025/4062%$0.010027d agocomplete
camp-code-dialect-gemma4qat-002
Run camp-code-dialect-gemma4qat-002: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT4040/40100%$0.008627d agocomplete
camp-noop-gemma4qat-002
Run camp-noop-gemma4qat-002: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT4040/40100%$0.001427d agocomplete
camp-trivial-belief-gemma4qat-002
Run camp-trivial-belief-gemma4qat-002: passed essentially everything (98%) -- this test did not challenge the model.
Gemma 4 31B QAT30/30%$0.000127d agocomplete
camp-tool-deep-gemma4qat-001
Run camp-tool-deep-gemma4qat-001: 73% pass rate on tool queries.
Gemma 4 31B QAT164119/162 · 2 err73%$0.054127d agocomplete
camp-code-length-gemma4qat-002
Run camp-code-length-gemma4qat-002: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT2423/23 · 1 err100%$0.006727d agocomplete
camp-code-lookalike-gemma4qat-002
Run camp-code-lookalike-gemma4qat-002: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT2423/23 · 1 err100%$0.005927d agocomplete
camp-code-dialect-gemma4qat-001
Run camp-code-dialect-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT2423/23 · 1 err100%$0.005227d agocomplete
camp-code-traps-gemma4qat-002
Run camp-code-traps-gemma4qat-002: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT2424/24100%$0.005227d agocomplete
camp-code-copy-gemma4qat-001
Run camp-code-copy-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT2423/23 · 1 err100%$0.004727d agocomplete
camp-interactive-lookalike-gemma4qat-002
Run camp-interactive-lookalike-gemma4qat-002: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT1513/13 · 2 err100%$0.044827d agocomplete
camp-tool_bp-gemma4qat-001
Run camp-tool_bp-gemma4qat-001: 70% pass rate on tool queries.
Gemma 4 31B QAT245172/24570%$0.033827d agocomplete
camp-interactive-fault-gemma4qat-003
Run camp-interactive-fault-gemma4qat-003: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT2116/16 · 5 err100%$0.008927d agocomplete
camp-tool-depth-gemma4qat-003
Run camp-tool-depth-gemma4qat-003: 84% pass rate on tool queries.
Gemma 4 31B QAT10689/10684%$0.024727d agocomplete
camp-breaking_point-gemma4qat-001
Run camp-breaking_point-gemma4qat-001: 43% pass rate on belief queries.
Gemma 4 31B QAT6829/6843%$0.004827d agocomplete
camp-belief-gemma4qat-001
Run camp-belief-gemma4qat-001: 59% pass rate on belief queries.
Gemma 4 31B QAT175104/17559%$0.005027d agocomplete
camp-tool_planning-gemma4qat-001
Run camp-tool_planning-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT105105/105100%$0.007427d agocomplete
camp-order-gemma4qat-001
Run camp-order-gemma4qat-001: 95% pass rate on order queries.
Gemma 4 31B QAT105100/10595%$0.004227d agocomplete
camp-premise-order-gemma4qat-001
Run camp-premise-order-gemma4qat-001: 83% pass rate on order queries.
Gemma 4 31B QAT2420/2483%$0.002327d agocomplete
camp-adversarial_belief-gemma4qat-001
Run camp-adversarial_belief-gemma4qat-001: 58% pass rate on belief queries.
Gemma 4 31B QAT10561/10558%$0.002627d agocomplete
camp-consistency-gemma4qat-001
Run camp-consistency-gemma4qat-001: 47% pass rate on tool queries.
Gemma 4 31B QAT209/19 · 1 err47%$0.004727d agocomplete
camp-tool-confuse-gemma4qat-001
Run camp-tool-confuse-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT9393/93100%$0.020327d agocomplete
camp-state-gemma4qat-001
Run camp-state-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT3030/30100%$0.001327d agocomplete
camp-trivial-belief-gemma4qat-001
Run camp-trivial-belief-gemma4qat-001: 79% pass rate on belief queries.
Gemma 4 31B QAT2419/2479%$0.000927d agocomplete
camp-noop-gemma4qat-001
Run camp-noop-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT2424/24100%$0.000827d agocomplete
camp-interactive-gemma4qat-003
Run camp-interactive-gemma4qat-003: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT32/2 · 1 err100%$0.001327d agocomplete
camp-ticket-trap-gemma4qat-002
Run camp-ticket-trap-gemma4qat-002: all 3 trials errored -- no usable signal.
Gemma 4 31B QAT3–$0.000027d agocomplete
camp-ticket-mechanism-gemma4qat-002
Run camp-ticket-mechanism-gemma4qat-002: all 3 trials errored -- no usable signal.
Gemma 4 31B QAT3–$0.000027d agocomplete
camp-ticket-length-gemma4qat-002
Run camp-ticket-length-gemma4qat-002: all 3 trials errored -- no usable signal.
Gemma 4 31B QAT3–$0.000027d agocomplete
camp-irrelevance-gemma4qat-002
Run camp-irrelevance-gemma4qat-002: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT1414/14100%$0.001527d agocomplete
camp-interactive-fault-gemma4qat-002
Run camp-interactive-fault-gemma4qat-002: 44% pass rate on interactive queries.
Gemma 4 31B QAT5524/5544%$0.056527d agocomplete
camp-interactive-gemma4qat-002
Run camp-interactive-gemma4qat-002: 47% pass rate on interactive queries.
Gemma 4 31B QAT5526/5547%$0.043627d agocomplete
camp-ticket-trap-gemma4qat-001
Run camp-ticket-trap-gemma4qat-001, 1 arms: clean on none; below 97% on ablate.
Gemma 4 31B QAT5412/5422%$0.045827d agocomplete
camp-ticket-mechanism-gemma4qat-001
Run camp-ticket-mechanism-gemma4qat-001, 1 arms: clean on none; below 97% on ablate.
Gemma 4 31B QAT5413/5424%$0.047927d agocomplete
camp-ticket-length-gemma4qat-001
Run camp-ticket-length-gemma4qat-001, 1 arms: clean on none; below 97% on ablate.
Gemma 4 31B QAT6333/6352%$0.048627d agocomplete
smoke-ticket-trap-gemma4qat
Run smoke-ticket-trap-gemma4qat: 50% pass rate on interactive queries.
Gemma 4 31B QAT21/250%$0.005728d agocomplete
smoke-ticket-mechanism-gemma4qat
Run smoke-ticket-mechanism-gemma4qat: 0% pass rate on interactive queries.
Gemma 4 31B QAT20/20%$0.002028d agocomplete
smoke-ticket-length-gemma4qat
Run smoke-ticket-length-gemma4qat: 50% pass rate on interactive queries.
Gemma 4 31B QAT21/250%$0.001428d agocomplete
camp-interactive-lookalike-gemma4qat-001
Run camp-interactive-lookalike-gemma4qat-001: passed essentially everything (97%) -- this test did not challenge the model.
Gemma 4 31B QAT5535/36 · 19 err97%$0.124028d agocomplete
camp-interactive-fault-gemma4qat-001
Run camp-interactive-fault-gemma4qat-001: 46% pass rate on interactive queries.
Gemma 4 31B QAT6526/56 · 9 err46%$0.058928d agocomplete
camp-interactive-gemma4qat-001
Run camp-interactive-gemma4qat-001: 45% pass rate on interactive queries.
Gemma 4 31B QAT6525/56 · 9 err45%$0.041028d agocomplete
camp-code-length-gemma4qat-001
Run camp-code-length-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT5656/56100%$0.017028d agocomplete
camp-code-lookalike-gemma4qat-001
Run camp-code-lookalike-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT5656/56100%$0.013928d agocomplete
camp-code-traps-gemma4qat-001
Run camp-code-traps-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT5656/56100%$0.012228d agocomplete
camp-full_map-gemma4qat-001
Full-map run camp-full_map-gemma4qat-001: clean on state, order, breaking_point, weak province: belief, adversarial_belief.
Gemma 4 31B QAT476318/47667%$0.012628d agocomplete
camp-irrelevance-gemma4qat-001
Run camp-irrelevance-gemma4qat-001: 90% pass rate on tool queries.
Gemma 4 31B QAT4036/4090%$0.004328d agocomplete
smoke-gemma4qat-code
Run smoke-gemma4qat-code: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT11/1100%$0.000128d agocomplete
smoke-gemma4qat-interactive
Run smoke-gemma4qat-interactive: all 1 trials errored -- no usable signal.
Gemma 4 31B QAT1–$0.000028d agocomplete
smoke-gemma4qat-tool
Run smoke-gemma4qat-tool: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT11/1100%$0.000128d agocomplete
smoke-gemma4qat-state
Run smoke-gemma4qat-state: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 4 31B QAT11/1100%$0.000028d agocomplete
camp-code-traps-gemma-001
Run camp-code-traps-gemma-001: 64% pass rate on code queries.
Gemma 3 27B13385/13364%$0.030628d agocomplete
camp-interactive-lookalike-gemma-001
Run camp-interactive-lookalike-gemma-001: 75% pass rate on interactive queries.
Gemma 3 27B3524/32 · 3 err75%$0.428828d agocomplete
camp-interactive-fault-gemma-001
Run camp-interactive-fault-gemma-001: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 3 27B4040/40100%$0.252828d agocomplete
camp-interactive-gemma-001
Run camp-interactive-gemma-001: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 3 27B4040/40100%$0.232228d agocomplete
camp-tool_bp-gemma-001
Run camp-tool_bp-gemma-001: 47% pass rate on tool queries.
Gemma 3 27B15472/15447%$0.019328d agocomplete
smoke-gemma-interactive-text2
Run smoke-gemma-interactive-text2: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 3 27B33/3100%$0.005328d agocomplete
camp-full_map-gemma-001
Full-map run camp-full_map-gemma-001: clean on order, breaking_point, weak province: state, belief, adversarial_belief.
Gemma 3 27B432246/43257%$0.014528d agocomplete
camp-code-length-gemma-001
Run camp-code-length-gemma-001: 82% pass rate on code queries.
Gemma 3 27B5646/5682%$0.019028d agocomplete
smoke-gemma-interactive-text
Run smoke-gemma-interactive-text: 0% pass rate on interactive queries.
Gemma 3 27B20/20%$0.001228d agocomplete
camp-tool-deep-gemma-001
Run camp-tool-deep-gemma-001: 43% pass rate on tool queries.
Gemma 3 27B7030/7043%$0.017028d agocomplete
camp-tool-depth-gemma-003
Run camp-tool-depth-gemma-003: 64% pass rate on tool queries.
Gemma 3 27B7749/7764%$0.015428d agocomplete
camp-code-lookalike-gemma-001
Run camp-code-lookalike-gemma-001: 93% pass rate on code queries.
Gemma 3 27B5652/5693%$0.013028d agocomplete
camp-tool-confuse-gemma-001
Run camp-tool-confuse-gemma-001: 82% pass rate on tool queries.
Gemma 3 27B5646/5682%$0.013128d agocomplete
camp-irrelevance-gemma-001
Run camp-irrelevance-gemma-001: 55% pass rate on tool queries.
Gemma 3 27B4022/4055%$0.004828d agocomplete
smoke-gemma-code
Run smoke-gemma-code: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 3 27B11/1100%$0.000128d agocomplete
smoke-gemma-interactive
Run smoke-gemma-interactive: 0% pass rate on interactive queries.
Gemma 3 27B10/10%$0.000028d agocomplete
smoke-gemma-tool
Run smoke-gemma-tool: 0% pass rate on tool queries.
Gemma 3 27B10/10%$0.000128d agocomplete
smoke-gemma-state
Run smoke-gemma-state: passed essentially everything (100%) -- this test did not challenge the model.
Gemma 3 27B11/1100%$0.000028d agocomplete
camp-interactive-fault-nano-001
Run camp-interactive-fault-nano-001: 87% pass rate on interactive queries.
Nemotron 3 Nano 30B2520/23 · 2 err87%$0.156128d agocomplete
camp-interactive-nano-002
Run camp-interactive-nano-002: 88% pass rate on interactive queries.
Nemotron 3 Nano 30B87/888%$0.094028d agocomplete
camp-interactive-lookalike-nano-002
Run camp-interactive-lookalike-nano-002: 67% pass rate on interactive queries.
Nemotron 3 Nano 30B1510/1567%$0.060828d agocomplete
camp-interactive-lookalike-super-002
Run camp-interactive-lookalike-super-002: 93% pass rate on interactive queries.
Nemotron 3 Super 120B1513/14 · 1 err93%$0.252728d agocomplete
camp-interactive-fault-super-001
Run camp-interactive-fault-super-001: passed essentially everything (100%) -- this test did not challenge the model.
Nemotron 3 Super 120B3533/33 · 2 err100%$0.152728d agocomplete
camp-interactive-lookalike-super-003
Run camp-interactive-lookalike-super-003: passed essentially everything (100%) -- this test did not challenge the model.
Nemotron 3 Super 120B2017/17 · 3 err100%$0.159028d agocomplete
camp-interactive-lookalike-ultra-001
Run camp-interactive-lookalike-ultra-001: all 10 trials errored -- no usable signal.
Nemotron 3 Ultra 550B10–$0.432228d agocomplete
camp-interactive-super-002
Run camp-interactive-super-002: passed essentially everything (100%) -- this test did not challenge the model.
Nemotron 3 Super 120B88/8100%$0.080028d agocomplete
camp-interactive-lookalike-nano-001
Run camp-interactive-lookalike-nano-001: 53% pass rate on interactive queries.
Nemotron 3 Nano 30B4519/36 · 9 err53%$0.150428d agocomplete
camp-interactive-lookalike-super-001
Run camp-interactive-lookalike-super-001: 85% pass rate on interactive queries.
Nemotron 3 Super 120B2517/20 · 5 err85%$0.208928d agocomplete
camp-interactive-super-001
Run camp-interactive-super-001: passed essentially everything (100%) -- this test did not challenge the model.
Nemotron 3 Super 120B4545/45100%$0.227128d agocomplete
camp-interactive-nano-001
Run camp-interactive-nano-001: passed essentially everything (97%) -- this test did not challenge the model.
Nemotron 3 Nano 30B4036/37 · 3 err97%$0.313728d agocomplete
camp-tool-deep-ultra-001
Run camp-tool-deep-ultra-001: 75% pass rate on tool queries.
Nemotron 3 Ultra 550B5642/5675%$0.331428d agocomplete
camp-tool-deep-super-001
Run camp-tool-deep-super-001: 60% pass rate on tool queries.
Nemotron 3 Super 120B9155/9160%$0.151328d agocomplete
smoke-interactive-nano-001
Run smoke-interactive-nano-001: passed essentially everything (100%) -- this test did not challenge the model.
Nemotron 3 Nano 30B22/2100%$0.011428d agocomplete
camp-tool-deep-nano-001
Run camp-tool-deep-nano-001: 29% pass rate on tool queries.
Nemotron 3 Nano 30B72/729%$0.002928d agocomplete
camp-irrelevance-ultra-001
Run camp-irrelevance-ultra-001: 85% pass rate on tool queries.
Nemotron 3 Ultra 550B2017/2085%$0.045429d agocomplete
camp-irrelevance-super-001
Run camp-irrelevance-super-001: 93% pass rate on tool queries.
Nemotron 3 Super 120B3028/3093%$0.012029d agocomplete
camp-irrelevance-nano-001
Run camp-irrelevance-nano-001: 73% pass rate on tool queries.
Nemotron 3 Nano 30B3022/3073%$0.009129d agocomplete
camp-tool-depth-super-003
Run camp-tool-depth-super-003, 1 arms: clean on none; below 97% on k15.
Nemotron 3 Super 120B3218/3256%$0.051929d agocomplete
camp-tool_bp-nano-002
Run camp-tool_bp-nano-002: 52% pass rate on tool queries.
Nemotron 3 Nano 30B12665/12652%$0.067929d agocomplete
camp-tool-confuse-super-001
Run camp-tool-confuse-super-001: passed essentially everything (100%) -- this test did not challenge the model.
Nemotron 3 Super 120B5656/56100%$0.029635d agocomplete
camp-tool-count-super-001
Run camp-tool-count-super-001: passed essentially everything (100%) -- this test did not challenge the model.
Nemotron 3 Super 120B5656/56100%$0.029935d agocomplete
camp-tool-depth-ultra-003
Run camp-tool-depth-ultra-003: 95% pass rate on tool queries.
Nemotron 3 Ultra 550B5653/5695%$0.235935d agocomplete
camp-tool-depth-nano-003
Run camp-tool-depth-nano-003: 65% pass rate on tool queries.
Nemotron 3 Nano 30B9864/9865%$0.071135d agocomplete
camp-tool-depth-ultra-002
Run camp-tool-depth-ultra-002, 1 arms: clean on none; below 97% on topup15.
Nemotron 3 Ultra 550B76/786%$0.034835d agocomplete
camp-tool-depth-super-002
Run camp-tool-depth-super-002, 1 arms: clean on none; below 97% on captokens.
Nemotron 3 Super 120B106/1060%$0.017935d agocomplete
test-parallel-parallel6
Run test-parallel-parallel6: passed essentially everything (100%) -- this test did not challenge the model.
Nemotron 3 Nano 30B66/6100%$0.004335d agocomplete
test-parallel-sequential
Run test-parallel-sequential: passed essentially everything (100%) -- this test did not challenge the model.
Nemotron 3 Nano 30B65/5 · 1 err100%$0.004335d agocomplete
camp-tool-depth-nano-002
Run camp-tool-depth-nano-002: 65% pass rate on tool queries.
Nemotron 3 Nano 30B9860/93 · 5 err65%$0.071036d agocomplete
camp-tool-depth-nano-001
Run camp-tool-depth-nano-001: 66% pass rate on tool queries.
Nemotron 3 Nano 30B4429/4466%$0.032936d agocomplete
camp-propose-toolworld-001
Run camp-propose-toolworld-001, 2 arms: clean on none; below 97% on control, round3.
Nemotron 3 Nano 30B4026/33 · 7 err79%$0.019440d agocomplete
camp-nemrender-showcase-001
Run camp-nemrender-showcase-001: passed essentially everything (97%) -- this test did not challenge the model.
Nemotron 3 Super 120B4634/3597%$0.007940d agocomplete
camp-tool_bp-nano-001
Run camp-tool_bp-nano-001: 66% pass rate on tool queries.
Nemotron 3 Nano 30B15495/144 · 10 err66%$0.068140d agocomplete
camp-tool_bp-ultra-001
Run camp-tool_bp-ultra-001: 91% pass rate on tool queries.
Nemotron 3 Ultra 550B5651/5691%$0.178040d agocomplete
camp-tool_bp-super-001
Run camp-tool_bp-super-001: passed essentially everything (98%) -- this test did not challenge the model.
Nemotron 3 Super 120B5651/52 · 4 err98%$0.034840d agocomplete
camp-tool_planning-adv-ultra-001
Run camp-tool_planning-adv-ultra-001: passed essentially everything (100%) -- this test did not challenge the model.
Nemotron 3 Ultra 550B4040/40100%$0.037340d agocomplete
camp-tool_planning-adv-super-001
Run camp-tool_planning-adv-super-001: passed essentially everything (100%) -- this test did not challenge the model.
Nemotron 3 Super 120B4040/40100%$0.006140d agocomplete
camp-tool_planning-super-001
Run camp-tool_planning-super-001: passed essentially everything (100%) -- this test did not challenge the model.
Nemotron 3 Super 120B4040/40100%$0.005941d agocomplete
camp-full_map-nano-002
Full-map run camp-full_map-nano-002: clean on state, order, breaking_point, weak province: belief, adversarial_belief.
Nemotron 3 Nano 30B516453/502 · 14 err90%$0.105041d agocomplete
camp-full_map-super-002
Full-map run camp-full_map-super-002: clean on order, belief, breaking_point, weak province: state, adversarial_belief.
Nemotron 3 Super 120B456441/45697%$0.159541d agocomplete
camp-full_map-ultra-002
Full-map run camp-full_map-ultra-002: passes every stage cleanly -- this battery did not find a limit.
Nemotron 3 Ultra 550B426418/421 · 5 err99%$0.944541d agocomplete
camp-tool_planning-nvidia-nemotron-3-nano-30b-a3b-001
Run camp-tool_planning-nvidia-nemotron-3-nano-30b-a3b-001: passed essentially everything (98%) -- this test did not challenge the model.
Nemotron 3 Nano 30B4039/4098%$0.005741d agocomplete
camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001
Full-map run camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001: clean on state, order, breaking_point, weak province: belief, adversarial_belief.
Nemotron 3 Nano 30B526465/506 · 20 err92%$0.102141d agocomplete
camp-belief-nemotron-nano-001
Run camp-belief-nemotron-nano-001: 93% pass rate on belief queries.
Nemotron 3 Nano 30B10598/10593%$0.013944d agocomplete
camp-state-nemotron-nano-001
Run camp-state-nemotron-nano-001: passed essentially everything (100%) -- this test did not challenge the model.
Nemotron 3 Nano 30B3030/30100%$0.005044d agocomplete
camp-belief-nemotron-super-002
Run camp-belief-nemotron-super-002: 96% pass rate on belief queries.
Nemotron 3 Super 120B105101/10596%$0.029544d agocomplete
camp-belief-nemotron-super-001
Run camp-belief-nemotron-super-001: 47% pass rate on belief queries.
Nemotron 3 Super 120B265123/264 · 1 err47%$0.091144d agocomplete
camp-state-nemotron-super-001
Run camp-state-nemotron-super-001: 97% pass rate on state queries.
Nemotron 3 Super 120B3029/3097%$0.012244d agocomplete
camp-belief-120b-001
Run camp-belief-120b-001: 53% pass rate on belief queries.
gpt-oss-120b214113/21453%$0.059544d agocomplete
camp-state-120b-001
Run camp-state-120b-001: passed essentially everything (100%) -- this test did not challenge the model.
gpt-oss-120b3030/30100%$0.012544d agocomplete