Qwen3 Coder

OpenRouter

262K context$0.22/M input$1.00/M output

1417peak 1427

Avg Score

60.6

Avg Cost

$0.11

Score/$

560.0

Runs

119

Win/Loss/Draw

Scoring Dimensions

Score Distribution

Category ELOs

frontendexpert

1838

multi-languagehard

1829

refactoringexpert

1711

debuggingmedium

1703

debugginghard

1531

full-stackmedium

1516

debugging

1495

frontendhard

1488

multi-languageexpert

1487

multi-language

1468

backendmedium

1465

backendhard

1436

from-scratchexpert

1414

backend

1413

from-scratchhard

1412

frontend

1410

full-stack

1405

refactoring

1405

debuggingexpert

1385

frontendmedium

1382

from-scratch

1367

refactoringmedium

1359

code-reviewmedium

1354

full-stackhard

1342

frontendeasy

1315

backendexpert

1291

from-scratcheasy

1290

code-review

1248

from-scratchmedium

1229

backendeasy

923

code-reviewhard

669

All Results

Task	Category	Score	Duration	Cost
Write tests for untested legacy Flask service	code-review	49.0	1m 3s	$0.03
Add file upload with S3 presigned URLs	backend	80.1	35.1s	$0.03
Build real-time portfolio risk calculator	backend	49.8	48.5s	$0.02
Debug and fix 6 broken database triggers and constraints	debugging	49.6	32.5s	$0.01
Debug race condition in worker pool	debugging	89.2	4.5s	<$0.01
Fix 12 WCAG accessibility violations in checkout form	frontend	75.3	43.2s	$0.02
Migrate callback-hell Express app to async/await	refactoring	64.1	27.4s	$0.02
Add cursor-based pagination to REST API	backend	71.2	25.7s	$0.03
Fix Node.js stream backpressure causing OOM on large files	backend	88.3	13.8s	$0.02
Add streaming SSE endpoint for LLM chat	backend	81.8	26.1s	$0.03
Add i18n with locale routing to Next.js app	full-stack	62.5	57.6s	$0.03
Fix broken GitHub Actions CI pipeline	debugging	84.8	22.8s	$0.02
Fix deadlocking transaction patterns in Flask app	backend	72.3	19.0s	<$0.01
Fix hallucination and context window bugs in RAG agent	backend	44.8	34.1s	$0.02
Add rate limiting middleware	backend	40.0	22.5s	<$0.01
Port Python CLI to Rust	multi-language	39.0	18.8s	<$0.01
Build SaaS admin dashboard from scratch	from-scratch	57.8	1m 5s	$0.03
Add slash commands and moderation to Discord bot	backend	79.5	15.3s	<$0.01
Build production website with auth and members area	frontend	66.1	2m 12s	$0.05
Replace console.log with structured logging	refactoring	45.0	37.9s	$0.03
Add virtual scrolling to table rendering 5000 rows	frontend	71.5	20.3s	$0.02
Build materialized view refresh pipeline for analytics	backend	73.3	46.2s	$0.02
Implement multi-tenant row-level security in Postgres	backend	59.1	40.8s	$0.02
Refactor monolithic handler to CQRS	refactoring	79.3	38.4s	$0.03
Build RAG pipeline with vector search	backend	47.4	16.0s	<$0.01
Implement Stripe webhook handler	backend	82.8	20.6s	$0.02
Build terminal UI dashboard	from-scratch	37.1	29.9s	$0.01
Fix React hydration mismatch	frontend	85.3	16.6s	$0.02
Fix data integrity bugs in denormalized e-commerce schema	debugging	81.0	5.6s	<$0.01
Implement background job scheduler with persistence	backend	37.3	1m 18s	$0.02
Build CLI tool with subcommands and config	from-scratch	61.4	59.4s	$0.02
Split 1100-line god file into proper modules	refactoring	67.1	32.4s	$0.02
Optimize slow Postgres queries in Flask app	backend	62.4	22.4s	<$0.01
Find and fix 4 hidden backdoors in Flask app	debugging	91.3	13.2s	<$0.01
Fix flaky test suite	debugging	86.0	8.5s	<$0.01
Fix auth bypass vulnerability	debugging	82.8	27.2s	$0.02
Add retry logic and dead letter queue to Python task queue	backend	79.4	13.0s	<$0.01
Add GraphQL layer over REST API	multi-language	78.1	20.5s	$0.02
Implement zero-trust API authentication layer	backend	61.2	40.5s	$0.02
Fix broken responsive layout	frontend	64.0	24.4s	$0.03
Fix N+1 query in dashboard	backend	54.4	8.4s	<$0.01
Build LLM evaluation harness with structured grading	backend	45.4	38.0s	$0.02
Convert React app to PWA with offline support	frontend	72.4	19.0s	$0.02
Harden insecure Docker setup with 12 vulnerabilities	code-review	47.1	18.8s	$0.02
Find and patch all OWASP Top 10 vulnerabilities	debugging	66.2	47.2s	$0.02
Add Redis caching layer to Express API	backend	81.3	23.7s	$0.02
Write integration tests for payment flow	code-review	64.2	31.1s	$0.03
Add Google OAuth2 login to Express app	full-stack	82.0	27.2s	$0.03
Fix memory leak in event handler	debugging	70.9	17.4s	$0.02
Implement transformer inference engine with KV cache	from-scratch	74.2	12.2s	<$0.01
Implement JWT auth middleware	backend	44.3	18.9s	$0.02
Write Kubernetes manifests for Node.js microservice	full-stack	85.0	10.8s	$0.01
Code review: identify security vulns	code-review	75.0	23.0s	$0.02
Dockerize Node.js monorepo	full-stack	70.8	11.9s	$0.01
Write complex SQL report with window functions	backend	62.4	55.7s	$0.02
Remove AI slop and over-engineering from codebase	refactoring	80.0	15.8s	$0.01
Build MCP server for database management	backend	74.5	35.6s	$0.01
Add WebSocket real-time updates	full-stack	59.5	17.4s	$0.02
Build codebase indexer for LLM context windows	from-scratch	42.4	43.2s	$0.02
Zero-downtime schema migration	full-stack	53.9	10.0s	<$0.01
Build REST API from scratch	from-scratch	72.5	15.8s	<$0.01
Add caching layer to eliminate slow SSR page loads	full-stack	83.5	25.6s	$0.02
Build distributed node cluster with gossip protocol	from-scratch	27.4	23.6s	<$0.01
Optimize bloated React bundle under 500KB	frontend	33.8	1m 30s	$0.04
Fix race conditions in order matching engine	backend	59.9	52.9s	$0.01
Add file upload with S3 presigned URLs	backend	9.8	2m 8s	$0.49
Convert React app to PWA with offline support	frontend	31.6	3m 6s	$0.59
Add i18n with locale routing to Next.js app	full-stack	34.3	1m 56s	$0.35
Remove AI slop and over-engineering from codebase	refactoring	31.9	2m 21s	$0.64
Implement zero-trust API authentication layer	backend	33.9	2m 28s	$0.43
Implement JWT auth middleware	backend	42.0	1m 42s	$0.20
Replace console.log with structured logging	refactoring	34.0	3m 28s	$0.56
Find and patch all OWASP Top 10 vulnerabilities	debugging	29.0	5m 23s	$1.06
Split 1100-line god file into proper modules	refactoring	33.5	7m 48s	$1.88
Implement multi-tenant row-level security in Postgres	backend	52.0	3m 4s	$0.63
Write Kubernetes manifests for Node.js microservice	full-stack	79.3	46.0s	$0.17
Build codebase indexer for LLM context windows	from-scratch	2.1	13m 48s	$1.66
Add caching layer to eliminate slow SSR page loads	full-stack	31.5	6m 36s	$0.47
Harden insecure Docker setup with 12 vulnerabilities	code-review	15.0	7m 56s	$0.29
Optimize bloated React bundle under 500KB	frontend	36.8	7m 59s	$0.87
Dockerize Node.js monorepo	full-stack	60.9	5m 3s	$0.35
Fix broken responsive layout	frontend	7.0	6m 38s	$0.78
Build production website with auth and members area	frontend	56.0	1m 12s	$0.02
Build SaaS admin dashboard from scratch	from-scratch	66.3	1m 1s	$0.02
Implement background job scheduler with persistence	backend	67.5	54.4s	$0.01
Build CLI tool with subcommands and config	from-scratch	45.5	47.6s	$0.01
Build MCP server for database management	backend	59.9	25.5s	<$0.01
Implement transformer inference engine with KV cache	from-scratch	53.3	13.5s	<$0.01
Build LLM evaluation harness with structured grading	backend	55.9	27.6s	<$0.01
Fix hallucination and context window bugs in RAG agent	backend	58.8	18.8s	<$0.01
Build real-time portfolio risk calculator	backend	53.0	36.0s	$0.01
Fix race conditions in order matching engine	backend	74.8	30.3s	<$0.01
Fix data integrity bugs in denormalized e-commerce schema	debugging	73.2	1m 1s	$0.02
Write complex SQL report with window functions	backend	72.5	32.4s	$0.01
Fix deadlocking transaction patterns in Flask app	backend	60.5	27.6s	<$0.01
Debug and fix 6 broken database triggers and constraints	debugging	71.0	20.5s	<$0.01
Find and fix 4 hidden backdoors in Flask app	debugging	83.3	18.1s	<$0.01
Write tests for untested legacy Flask service	code-review	45.3	38.6s	$0.01
Add Google OAuth2 login to Express app	full-stack	70.0	24.7s	<$0.01
Optimize slow Postgres queries in Flask app	backend	58.0	15.4s	<$0.01
Fix 12 WCAG accessibility violations in checkout form	frontend	78.7	45.4s	$0.01
Add slash commands and moderation to Discord bot	backend	57.1	22.4s	<$0.01
Add retry logic and dead letter queue to Python task queue	backend	62.2	21.2s	<$0.01
Fix Node.js stream backpressure causing OOM on large files	backend	80.3	5.7s	<$0.01
Add virtual scrolling to table rendering 5000 rows	frontend	54.4	11.8s	<$0.01
Build distributed node cluster with gossip protocol	from-scratch	41.9	30.9s	<$0.01
Write integration tests for payment flow	code-review	45.8	25.4s	<$0.01
Fix auth bypass vulnerability	debugging	92.4	8.8s	<$0.01
Zero-downtime schema migration	full-stack	48.7	5.6s	<$0.01
Add rate limiting middleware	backend	64.3	13.8s	<$0.01
Add cursor-based pagination to REST API	backend	62.4	9.2s	<$0.01
Fix flaky test suite	debugging	80.2	9.1s	<$0.01
Refactor monolithic handler to CQRS	refactoring	63.1	16.2s	<$0.01
Fix N+1 query in dashboard	backend	53.6	7.5s	<$0.01
Fix React hydration mismatch	frontend	77.7	4.7s	<$0.01
Fix memory leak in event handler	debugging	68.3	5.1s	<$0.01
Build terminal UI dashboard	from-scratch	55.0	21.1s	<$0.01
Build REST API from scratch	from-scratch	77.2	8.9s	<$0.01
Debug race condition in worker pool	debugging	93.3	5.8s	<$0.01