Published task benchmark

Scholarship Eligibility Screening

Given a student profile and supplied scholarship rules, classify eligibility, show each satisfied or unmet criterion, and flag ambiguous evidence.

Compare measured quality, workload cost, and latency across model tiers. Results are task-specific and directional—not a general model ranking.

Education & EdTechClassificationEvaluated 9/9/2026100 evaluation examplesFallback pricing checked September 11, 2026
Classification

Scholarship Eligibility Screening

Given a student profile and supplied scholarship rules, classify eligibility, show each satisfied or unmet criterion, and flag ambiguous evidence.

Education & EdTechPer application
Not benchmarked
No result on this tier
Token profile pending
/100K
Run this tier to add it
Nemotron Nano 9B v2
9B · Off-the-shelf
548 in · 737 out · 4.05s p50
$20.24 /100K
AWS Bedrock temporary list price
View token rates
AWS Bedrock · $0.0600 input · $0.2300 output /1M
55%
DeepSeek V3
Hosted · Off-the-shelf
513 in · 162 out · 1.90s p50
$32.53 /100K
Best current price · TrustedRouter
Compare 2 router rates · observed 9/11/2026
TrustedRouter · $0.3376 input · $0.9390 output /1M
OpenRouter · $0.2900 input · $1.14 output /1M
55%
GPT-5.4
Hosted · Off-the-shelf
498 in · 399 out · 4.10s p50
$723 /100K
Best current price · OpenRouter
Compare 2 router rates · observed 9/11/2026
OpenRouter · $2.50 input · $15.00 output /1M
TrustedRouter · $2.64 input · $15.82 output /1M
90%
Best accuracy
All 12 model results and methodology

Generated 100/100 examples

ModelTierQualityJudgedScenario cost
Nemotron Nano 9B v2small55%100/100$20.24
Qwen3 235B A22Bmid24%100/100$37.31
DeepSeek V3mid55%100/100$32.53
Mistral Large 2407mid24%100/100$59.82
Arcee Trinity Large Thinkingmid40%100/100$143
GPT-5.4frontier90%100/100$723
Claude Opus 4.7frontier89%100/100$1200
Gemini 3.1 Pro Previewfrontier85%100/100$1428
Gemma 4 E4B ITsmall19%100/100$1.96
Granite 4.1 8Bsmall15%100/100$3.31
Ministral 8B Instruct 2410small4%100/100$9.55
Qwen3 4B Instruct 2507small32%100/100$21.38

LLM-judge pass rate on 100 synthetic examples. Generator: gpt-5.2. Judge: gpt-5.2. Evaluated 2026-09-09T09:48:02.951Z.

Directional: measured on a synthetic eval set generated by drydock. Cost/latency are not yet captured for taskrouter-run benchmarks.

drydock

Have a neighboring workload?

Describe it in Task Explorer. If it is not measured yet, you can request a benchmark and follow future results.

Explore another task