Analysis

Reproduce an issue, locate the cause, implement a scoped fix, and run relevant tests.

Software engineering, data, and DevOpsPer issue

Not benchmarked

No result on this tier

Token profile pending

— /100K

Run this tier to add it

—

Gemma 4 E4B IT

E4B · Off-the-shelf

672 in · 1,336 out · 20.33s p50

$15.51 /100K

Current price · TrustedRouter

View token rates · observed 9/11/2026

TrustedRouter · $0.0211 input · $0.1055 output /1M

39%

Qwen3 235B A22B

235B (22B active) · Off-the-shelf

603 in · 1,094 out · 9.17s p50

$227 /100K

Best current price · OpenRouter

Compare 2 router rates · observed 9/11/2026

OpenRouter · $0.4550 input · $1.82 output /1M

TrustedRouter · $0.6330 input · $2.11 output /1M

49%

Claude Opus 4.7

Hosted · Off-the-shelf

980 in · 1,847 out · 19.90s p50

$5108 /100K

Best current price · OpenRouter

Compare 2 router rates · observed 9/11/2026

OpenRouter · $5.00 input · $25.00 output /1M

TrustedRouter · $5.28 input · $26.38 output /1M

62%

All 12 model results and methodology

Generated 90/100 examples — partial set accepted at the success threshold

Model	Tier	Quality	Judged	Scenario cost
Nemotron Nano 9B v2	small	18%	90/90	$38.94
Qwen3 235B A22B	mid	49%	90/90	$227
DeepSeek V3	mid	46%	90/90	$100
Mistral Large 2407	mid	43%	90/90	$189
Arcee Trinity Large Thinking	mid	31%	90/90	$147
GPT-5.4	frontier	1%	90/90	$1189
Claude Opus 4.7	frontier	62%	90/90	$5108
Gemini 3.1 Pro Preview	frontier	19%	90/90	$2511
Gemma 4 E4B IT	small	39%	90/90	$15.51
Granite 4.1 8B	small	24%	90/90	$11.63
Ministral 8B Instruct 2410	small	26%	90/90	$24.66
Qwen3 4B Instruct 2507	small	27%	90/90	$86.57

LLM-judge pass rate on 90 synthetic examples. Generator: gpt-5.2. Judge: gpt-5.2. Evaluated 2026-09-11T08:23:02.423Z.

Directional: measured on a synthetic eval set generated by drydock. Cost/latency are not yet captured for taskrouter-run benchmarks.

drydock

Have a neighboring workload?