Qwen3 Coder Flash

OpenRouter

1000K context$0.30/M input$1.50/M output

1344peak 1367

Avg Score

58.8

Avg Cost

$0.09

Score/$

662.3

Runs

120

Win/Loss/Draw

Scoring Dimensions

Score Distribution

Category ELOs

code-reviewhard

1808

from-scratchexpert

1578

frontendeasy

1501

full-stackhard

1496

full-stack

1459

backendmedium

1433

code-review

1411

frontendmedium

1397

full-stackmedium

1381

backend

1368

backendexpert

1362

refactoringmedium

1356

frontend

1346

refactoring

1333

code-reviewmedium

1325

backendhard

1310

multi-language

1262

from-scratchhard

1260

multi-languagehard

1226

debuggingexpert

1223

from-scratch

1190

debugginghard

1185

debugging

1181

from-scratchmedium

1151

multi-languageexpert

1147

frontendhard

1143

refactoringexpert

1028

frontendexpert

922

debuggingmedium

714

from-scratcheasy

668

backendeasy

337

All Results

Task	Category	Score	Duration	Cost
Fix 12 WCAG accessibility violations in checkout form	frontend	52.3	3m 18s	$0.08
Build SaaS admin dashboard from scratch	from-scratch	51.5	2m 53s	$0.03
Build materialized view refresh pipeline for analytics	backend	60.4	1m 25s	$0.02
Fix React hydration mismatch	frontend	85.9	48.0s	$0.05
Port Python CLI to Rust	multi-language	33.0	36.8s	<$0.01
Implement JWT auth middleware	backend	38.8	34.8s	$0.05
Migrate callback-hell Express app to async/await	refactoring	62.7	1m 5s	$0.03
Implement zero-trust API authentication layer	backend	65.0	1m 31s	$0.04
Fix N+1 query in dashboard	backend	44.4	13.2s	<$0.01
Add GraphQL layer over REST API	multi-language	69.2	56.3s	$0.05
Find and fix 4 hidden backdoors in Flask app	debugging	42.0	37.1s	$0.01
Add cursor-based pagination to REST API	backend	80.2	40.6s	$0.05
Implement background job scheduler with persistence	backend	39.2	2m 13s	$0.03
Convert React app to PWA with offline support	frontend	67.7	48.8s	$0.03
Write Kubernetes manifests for Node.js microservice	full-stack	82.4	20.7s	$0.02
Fix memory leak in event handler	debugging	72.0	34.4s	$0.05
Write complex SQL report with window functions	backend	70.2	46.7s	$0.01
Add virtual scrolling to table rendering 5000 rows	frontend	34.0	48.9s	$0.05
Write integration tests for payment flow	code-review	80.5	1m 30s	$0.06
Implement multi-tenant row-level security in Postgres	backend	51.5	1m 15s	$0.03
Add file upload with S3 presigned URLs	backend	53.0	1m 30s	$0.06
Implement transformer inference engine with KV cache	from-scratch	76.2	22.7s	<$0.01
Add rate limiting middleware	backend	40.2	36.7s	<$0.01
Find and patch all OWASP Top 10 vulnerabilities	debugging	64.3	1m 18s	$0.04
Fix Node.js stream backpressure causing OOM on large files	backend	85.9	35.5s	$0.05
Fix hallucination and context window bugs in RAG agent	backend	30.3	54.2s	$0.01
Code review: identify security vulns	code-review	75.0	54.9s	$0.05
Refactor monolithic handler to CQRS	refactoring	33.5	1m 14s	$0.06
Add slash commands and moderation to Discord bot	backend	70.8	34.1s	<$0.01
Replace console.log with structured logging	refactoring	38.5	1m 30s	$0.06
Build codebase indexer for LLM context windows	from-scratch	40.2	1m 16s	$0.02
Build CLI tool with subcommands and config	from-scratch	29.8	33.8s	<$0.01
Fix race conditions in order matching engine	backend	81.5	28.2s	<$0.01
Split 1100-line god file into proper modules	refactoring	70.8	1m 2s	$0.03
Add Google OAuth2 login to Express app	full-stack	55.6	1m 27s	$0.06
Fix flaky test suite	debugging	69.5	14.5s	<$0.01
Fix broken GitHub Actions CI pipeline	debugging	67.2	35.3s	$0.05
Build distributed node cluster with gossip protocol	from-scratch	28.9	30.2s	<$0.01
Add streaming SSE endpoint for LLM chat	backend	67.0	53.9s	$0.05
Add i18n with locale routing to Next.js app	full-stack	66.8	2m 1s	$0.05
Build production website with auth and members area	frontend	48.8	3m 50s	$0.04
Build MCP server for database management	backend	53.5	48.7s	$0.01
Remove AI slop and over-engineering from codebase	refactoring	72.9	36.2s	$0.02
Build REST API from scratch	from-scratch	68.5	16.6s	<$0.01
Add retry logic and dead letter queue to Python task queue	backend	64.1	38.4s	<$0.01
Optimize bloated React bundle under 500KB	frontend	62.6	2m 22s	$0.04
Zero-downtime schema migration	full-stack	80.5	7.7s	<$0.01
Fix broken responsive layout	frontend	68.5	1m 7s	$0.06
Build LLM evaluation harness with structured grading	backend	50.0	1m 29s	$0.02
Optimize slow Postgres queries in Flask app	backend	53.0	48.8s	$0.01
Build RAG pipeline with vector search	backend	46.2	53.7s	$0.01
Debug race condition in worker pool	debugging	80.2	5.8s	<$0.01
Add WebSocket real-time updates	full-stack	56.6	37.6s	$0.05
Debug and fix 6 broken database triggers and constraints	debugging	58.7	1m 9s	$0.02
Build real-time portfolio risk calculator	backend	29.9	1m 36s	$0.02
Dockerize Node.js monorepo	full-stack	65.8	30.1s	$0.03
Build terminal UI dashboard	from-scratch	50.3	40.7s	<$0.01
Add Redis caching layer to Express API	backend	74.3	1m 13s	$0.06
Add caching layer to eliminate slow SSR page loads	full-stack	81.7	1m 1s	$0.04
Harden insecure Docker setup with 12 vulnerabilities	code-review	70.6	15.0s	$0.02
Fix data integrity bugs in denormalized e-commerce schema	debugging	77.7	42.4s	<$0.01
Implement Stripe webhook handler	backend	59.3	36.7s	$0.05
Write tests for untested legacy Flask service	code-review	32.1	1m 39s	$0.02
Fix auth bypass vulnerability	debugging	45.8	49.4s	$0.05
Fix deadlocking transaction patterns in Flask app	backend	63.0	32.5s	<$0.01
Fix broken responsive layout	frontend	55.5	1m 45s	$0.13
Remove AI slop and over-engineering from codebase	refactoring	77.5	1m 8s	$0.26
Split 1100-line god file into proper modules	refactoring	65.2	3m 54s	$0.61
Write Kubernetes manifests for Node.js microservice	full-stack	3.5	10.9s	<$0.01
Implement zero-trust API authentication layer	backend	26.1	5m 9s	$0.76
Implement JWT auth middleware	backend	79.5	43.9s	$0.06
Add i18n with locale routing to Next.js app	full-stack	57.4	5m 9s	$0.52
Convert React app to PWA with offline support	frontend	47.0	1m 37s	$0.20
Add caching layer to eliminate slow SSR page loads	full-stack	71.1	1m 28s	$0.14
Dockerize Node.js monorepo	full-stack	53.8	1m 4s	$0.13
Find and patch all OWASP Top 10 vulnerabilities	debugging	53.5	4m 22s	$0.46
Optimize bloated React bundle under 500KB	frontend	64.0	3m 4s	$0.49
Replace console.log with structured logging	refactoring	47.8	2m 35s	$0.26
Implement multi-tenant row-level security in Postgres	backend	71.7	1m 49s	$0.20
Build codebase indexer for LLM context windows	from-scratch	47.6	2m 44s	$0.25
Harden insecure Docker setup with 12 vulnerabilities	code-review	62.9	33.2s	$0.03
Implement transformer inference engine with KV cache	from-scratch	57.8	3m 2s	$0.29
Implement background job scheduler with persistence	backend	51.3	3m 36s	$0.38
Add retry logic and dead letter queue to Python task queue	backend	74.3	6m 14s	$0.28
Build MCP server for database management	backend	65.7	2m 5s	$0.18
Debug and fix 6 broken database triggers and constraints	debugging	63.1	3m 9s	$0.61
Fix data integrity bugs in denormalized e-commerce schema	debugging	57.5	2m 46s	$0.62
Fix flaky test suite	debugging	65.8	2m 16s	$0.17
Build LLM evaluation harness with structured grading	backend	55.8	6m 53s	$0.67
Fix race conditions in order matching engine	backend	84.4	1m 16s	$0.12
Add slash commands and moderation to Discord bot	backend	75.8	1m 8s	$0.10
Build real-time portfolio risk calculator	backend	39.0	4m 32s	$0.55
Zero-downtime schema migration	full-stack	85.6	34.2s	$0.05
Write complex SQL report with window functions	backend	78.9	1m 9s	$0.07
Build production website with auth and members area	frontend	46.8	2m 2s	$0.02
Build SaaS admin dashboard from scratch	from-scratch	50.5	1m 41s	$0.02
Build CLI tool with subcommands and config	from-scratch	36.8	31.1s	<$0.01
Fix hallucination and context window bugs in RAG agent	backend	52.0	27.6s	<$0.01
Build materialized view refresh pipeline for analytics	backend	30.0	22.2s	<$0.01
Fix deadlocking transaction patterns in Flask app	backend	33.8	28.1s	<$0.01
Find and fix 4 hidden backdoors in Flask app	debugging	80.8	23.5s	<$0.01
Write tests for untested legacy Flask service	code-review	47.2	32.6s	<$0.01
Add Google OAuth2 login to Express app	full-stack	63.9	30.2s	<$0.01
Fix 12 WCAG accessibility violations in checkout form	frontend	73.0	54.6s	$0.01
Optimize slow Postgres queries in Flask app	backend	66.1	26.1s	<$0.01
Add virtual scrolling to table rendering 5000 rows	frontend	66.0	13.8s	<$0.01
Fix Node.js stream backpressure causing OOM on large files	backend	89.5	4.8s	<$0.01
Build distributed node cluster with gossip protocol	from-scratch	28.4	25.2s	<$0.01
Write integration tests for payment flow	code-review	67.5	23.1s	<$0.01
Fix auth bypass vulnerability	debugging	78.4	10.5s	<$0.01
Add GraphQL layer over REST API	multi-language	57.0	12.4s	<$0.01
Add rate limiting middleware	backend	50.5	9.9s	<$0.01
Implement Stripe webhook handler	backend	37.5	6.6s	<$0.01
Fix N+1 query in dashboard	backend	65.4	10.1s	<$0.01
Refactor monolithic handler to CQRS	refactoring	53.9	17.6s	<$0.01
Fix memory leak in event handler	debugging	63.4	4.2s	<$0.01
Fix React hydration mismatch	frontend	68.3	5.4s	<$0.01
Build terminal UI dashboard	from-scratch	41.2	17.2s	<$0.01
Debug race condition in worker pool	debugging	58.0	3.7s	<$0.01
Build REST API from scratch	from-scratch	70.2	9.4s	<$0.01