Qwen3 Coder Plus

OpenRouter

1000K context$1.00/M input$5.00/M output

1420peak 1428

Avg Score

62.8

Avg Cost

$0.12

Score/$

504.2

Runs

117

Win/Loss/Draw

Scoring Dimensions

Score Distribution

Category ELOs

from-scratchexpert

1733

from-scratchmedium

1644

debugginghard

1608

debuggingexpert

1572

from-scratcheasy

1534

debugging

1495

full-stackhard

1460

backendmedium

1450

full-stack

1438

frontendmedium

1430

frontendexpert

1420

full-stackmedium

1417

backendhard

1415

backend

1411

from-scratch

1410

refactoringmedium

1406

frontend

1400

refactoring

1399

backendexpert

1373

code-reviewhard

1309

code-review

1297

from-scratchhard

1288

code-reviewmedium

1285

multi-languagehard

1284

multi-language

1271

frontendeasy

1264

debuggingmedium

1220

refactoringexpert

1160

multi-languageexpert

1147

frontendhard

939

backendeasy

337

All Results

Task	Category	Score	Duration	Cost
Build production website with auth and members area	frontend	54.8	5m 38s	$0.14
Build terminal UI dashboard	from-scratch	55.1	51.1s	$0.02
Build CLI tool with subcommands and config	from-scratch	44.4	1m 13s	$0.03
Zero-downtime schema migration	full-stack	72.2	17.0s	<$0.01
Split 1100-line god file into proper modules	refactoring	61.6	1m 10s	$0.13
Build REST API from scratch	from-scratch	74.5	35.4s	$0.01
Fix data integrity bugs in denormalized e-commerce schema	debugging	87.0	56.9s	$0.03
Optimize slow Postgres queries in Flask app	backend	82.6	41.3s	$0.02
Add Redis caching layer to Express API	backend	84.9	1m 23s	$0.22
Remove AI slop and over-engineering from codebase	refactoring	66.3	1m 3s	$0.11
Fix React hydration mismatch	frontend	74.8	30.2s	$0.18
Add virtual scrolling to table rendering 5000 rows	frontend	76.6	31.1s	$0.18
Implement background job scheduler with persistence	backend	49.9	42.7s	$0.02
Replace console.log with structured logging	refactoring	64.0	9m 10s	$0.39
Optimize bloated React bundle under 500KB	frontend	66.1	2m 1s	$0.16
Fix 12 WCAG accessibility violations in checkout form	frontend	69.3	1m 43s	$0.23
Write tests for untested legacy Flask service	code-review	47.3	1m 57s	$0.06
Harden insecure Docker setup with 12 vulnerabilities	code-review	47.3	45.7s	$0.18
Fix broken GitHub Actions CI pipeline	debugging	77.0	35.1s	$0.19
Build distributed node cluster with gossip protocol	from-scratch	35.5	1m 54s	$0.07
Write integration tests for payment flow	code-review	71.8	1m 26s	$0.22
Implement JWT auth middleware	backend	49.4	1m 17s	$0.21
Build codebase indexer for LLM context windows	from-scratch	43.0	1m 25s	$0.05
Code review: identify security vulns	code-review	63.0	1m 43s	$0.22
Write complex SQL report with window functions	backend	62.6	2m 19s	$0.08
Fix broken responsive layout	frontend	44.2	34.4s	$0.21
Add slash commands and moderation to Discord bot	backend	70.5	35.1s	$0.02
Fix Node.js stream backpressure causing OOM on large files	backend	74.0	22.8s	$0.17
Build RAG pipeline with vector search	backend	37.3	54.1s	$0.03
Implement transformer inference engine with KV cache	from-scratch	79.5	30.6s	$0.02
Add rate limiting middleware	backend	45.0	39.9s	$0.02
Build materialized view refresh pipeline for analytics	backend	72.3	1m 53s	$0.06
Refactor monolithic handler to CQRS	refactoring	38.5	38.5s	$0.19
Implement zero-trust API authentication layer	backend	67.1	55.1s	$0.11
Add file upload with S3 presigned URLs	backend	75.7	1m 5s	$0.20
Add Google OAuth2 login to Express app	full-stack	80.0	1m 34s	$0.21
Add retry logic and dead letter queue to Python task queue	backend	77.0	25.8s	$0.01
Debug race condition in worker pool	debugging	86.4	4.4s	<$0.01
Build MCP server for database management	backend	80.2	37.9s	$0.02
Find and fix 4 hidden backdoors in Flask app	debugging	87.7	21.7s	$0.01
Implement Stripe webhook handler	backend	74.9	29.3s	$0.17
Fix auth bypass vulnerability	debugging	73.2	44.8s	$0.17
Dockerize Node.js monorepo	full-stack	71.0	54.5s	$0.12
Add GraphQL layer over REST API	multi-language	70.1	1m 23s	$0.20
Fix hallucination and context window bugs in RAG agent	backend	27.4	1m 11s	$0.05
Write Kubernetes manifests for Node.js microservice	full-stack	75.5	19.0s	$0.09
Convert React app to PWA with offline support	frontend	69.3	37.1s	$0.12
Build LLM evaluation harness with structured grading	backend	70.9	48.7s	$0.02
Add caching layer to eliminate slow SSR page loads	full-stack	80.8	46.5s	$0.13
Build real-time portfolio risk calculator	backend	37.2	58.0s	$0.04
Port Python CLI to Rust	multi-language	32.8	49.9s	$0.02
Add i18n with locale routing to Next.js app	full-stack	61.9	2m 47s	$0.21
Migrate callback-hell Express app to async/await	refactoring	60.7	1m 35s	$0.23
Fix deadlocking transaction patterns in Flask app	backend	68.2	49.2s	$0.03
Find and patch all OWASP Top 10 vulnerabilities	debugging	63.9	1m 41s	$0.15
Fix flaky test suite	debugging	22.8	46.2s	$0.03
Build SaaS admin dashboard from scratch	from-scratch	51.8	2m 46s	$0.08
Fix N+1 query in dashboard	backend	37.0	26.1s	$0.01
Implement multi-tenant row-level security in Postgres	backend	61.6	2m 33s	$0.27
Add streaming SSE endpoint for LLM chat	backend	71.7	46.8s	$0.19
Debug and fix 6 broken database triggers and constraints	debugging	83.8	41.1s	$0.02
Add cursor-based pagination to REST API	backend	76.9	33.2s	$0.18
Fix race conditions in order matching engine	backend	79.3	37.6s	$0.02
Fix memory leak in event handler	debugging	78.8	27.1s	$0.18
Add WebSocket real-time updates	full-stack	70.5	30.5s	$0.18
Optimize bloated React bundle under 500KB	frontend	67.4	5m 42s	$0.64
Add caching layer to eliminate slow SSR page loads	full-stack	74.2	2m 36s	$0.18
Add i18n with locale routing to Next.js app	full-stack	57.9	5m 13s	$0.48
Implement JWT auth middleware	backend	80.9	49.0s	$0.05
Find and patch all OWASP Top 10 vulnerabilities	debugging	71.0	5m 44s	$0.54
Convert React app to PWA with offline support	frontend	62.4	4m 35s	$0.60
Dockerize Node.js monorepo	full-stack	69.8	1m 17s	$0.10
Replace console.log with structured logging	refactoring	42.6	4m 45s	$0.54
Fix broken responsive layout	frontend	70.0	2m 24s	$0.12
Implement zero-trust API authentication layer	backend	69.5	5m 48s	$0.63
Harden insecure Docker setup with 12 vulnerabilities	code-review	73.5	2m 10s	$0.13
Remove AI slop and over-engineering from codebase	refactoring	78.8	1m 52s	$0.36
Split 1100-line god file into proper modules	refactoring	66.8	5m 57s	$1.17
Build codebase indexer for LLM context windows	from-scratch	41.5	6m 21s	$0.62
Write Kubernetes manifests for Node.js microservice	full-stack	81.5	1m 53s	$0.14
Implement multi-tenant row-level security in Postgres	backend	65.9	2m 29s	$0.24
Build production website with auth and members area	frontend	61.1	1m 58s	$0.06
Build SaaS admin dashboard from scratch	from-scratch	59.4	1m 31s	$0.05
Build MCP server for database management	backend	65.3	26.3s	$0.02
Implement transformer inference engine with KV cache	from-scratch	69.5	27.5s	$0.02
Build CLI tool with subcommands and config	from-scratch	38.0	51.4s	$0.03
Build real-time portfolio risk calculator	backend	53.7	1m 5s	$0.04
Build materialized view refresh pipeline for analytics	backend	50.0	1m 37s	$0.06
Implement background job scheduler with persistence	backend	26.5	5.6s	<$0.01
Fix hallucination and context window bugs in RAG agent	backend	63.0	32.6s	$0.02
Fix race conditions in order matching engine	backend	77.3	40.5s	$0.02
Build LLM evaluation harness with structured grading	backend	32.3	8.3s	<$0.01
Fix data integrity bugs in denormalized e-commerce schema	debugging	38.0	44.8s	$0.03
Write complex SQL report with window functions	backend	72.7	51.9s	$0.04
Fix deadlocking transaction patterns in Flask app	backend	57.9	36.1s	$0.02
Debug and fix 6 broken database triggers and constraints	debugging	53.8	26.9s	$0.02
Find and fix 4 hidden backdoors in Flask app	debugging	39.4	4.8s	<$0.01
Fix 12 WCAG accessibility violations in checkout form	frontend	64.9	1m 42s	$0.06
Optimize slow Postgres queries in Flask app	backend	61.9	23.1s	$0.02
Write tests for untested legacy Flask service	code-review	24.5	4.9s	<$0.01
Add retry logic and dead letter queue to Python task queue	backend	60.6	20.1s	$0.01
Build distributed node cluster with gossip protocol	from-scratch	27.5	48.7s	$0.02
Add virtual scrolling to table rendering 5000 rows	frontend	63.9	16.3s	$0.02
Fix Node.js stream backpressure causing OOM on large files	backend	87.9	7.1s	<$0.01
Write integration tests for payment flow	code-review	63.9	28.4s	$0.02
Add GraphQL layer over REST API	multi-language	53.6	23.9s	$0.02
Fix auth bypass vulnerability	debugging	94.7	9.9s	$0.01
Add rate limiting middleware	backend	49.8	19.7s	<$0.01
Zero-downtime schema migration	full-stack	61.0	8.9s	<$0.01
Fix flaky test suite	debugging	61.8	14.1s	<$0.01
Refactor monolithic handler to CQRS	refactoring	57.8	15.0s	$0.01
Fix N+1 query in dashboard	backend	58.8	7.5s	<$0.01
Fix memory leak in event handler	debugging	56.5	5.5s	<$0.01
Fix React hydration mismatch	frontend	74.9	4.4s	<$0.01
Build terminal UI dashboard	from-scratch	62.4	21.6s	<$0.01
Debug race condition in worker pool	debugging	92.5	5.3s	<$0.01
Build REST API from scratch	from-scratch	73.3	9.6s	<$0.01