Generation

Given a question, correct answer, and misconception taxonomy, generate plausible distinct distractors tied to specified misconceptions.

Education & EdTechPer question

Not benchmarked

No result on this tier

Token profile pending

— /100K

Run this tier to add it

—

Nemotron Nano 9B v2

9B · Off-the-shelf

345 in · 1,466 out · 10.52s p50

$35.79 /100K

AWS Bedrock temporary list price

View token rates

AWS Bedrock · $0.0600 input · $0.2300 output /1M

39%

DeepSeek V3

Hosted · Off-the-shelf

325 in · 100 out · 1.36s p50

$20.36 /100K

Best current price · TrustedRouter

Compare 2 router rates · observed 9/11/2026

TrustedRouter · $0.3376 input · $0.9390 output /1M

OpenRouter · $0.2900 input · $1.14 output /1M

60%

GPT-5.4

Hosted · Off-the-shelf

325 in · 110 out · 1.74s p50

$246 /100K

Best current price · OpenRouter

Compare 2 router rates · observed 9/11/2026

OpenRouter · $2.50 input · $15.00 output /1M

TrustedRouter · $2.64 input · $15.82 output /1M

71%

All 12 model results and methodology

Generated 100/100 examples

Model	Tier	Quality	Judged	Scenario cost
Nemotron Nano 9B v2	small	39%	100/100	$35.79
Qwen3 235B A22B	mid	52%	100/100	$90.82
DeepSeek V3	mid	60%	100/100	$20.36
Mistral Large 2407	mid	51%	100/100	$53.65
Arcee Trinity Large Thinking	mid	15%	100/100	$153
GPT-5.4	frontier	71%	100/100	$246
Claude Opus 4.7	frontier	69%	100/100	$1353
Gemini 3.1 Pro Preview	frontier	60%	100/100	$1518
Gemma 4 E4B IT	small	36%	100/100	$2.53
Granite 4.1 8B	small	31%	100/100	$6.08
Ministral 8B Instruct 2410	small	23%	100/100	$7.37
Qwen3 4B Instruct 2507	small	18%	100/100	$46.72

LLM-judge pass rate on 100 synthetic examples. Generator: gpt-5.2. Judge: gpt-5.2. Evaluated 2026-09-09T09:06:02.690Z.

Directional: measured on a synthetic eval set generated by drydock. Cost/latency are not yet captured for taskrouter-run benchmarks.

drydock

Have a neighboring workload?