Deepseek R1 0528

OpenRouter

164K context$0.40/M input$1.75/M output

1386peak 1405

Avg Score

64.4

Avg Cost

$0.04

Score/$

1452.6

Runs

Win/Loss/Draw

Scoring Dimensions

Score Distribution

Category ELOs

from-scratchexpert

2005

backendeasy

1929

debugginghard

1557

backendexpert

1536

frontendeasy

1487

full-stackhard

1473

full-stack

1437

backend

1429

debugging

1421

frontendexpert

1403

multi-languagehard

1402

backendhard

1391

full-stackmedium

1383

frontendmedium

1372

frontend

1369

backendmedium

1355

debuggingexpert

1349

from-scratch

1289

code-reviewmedium

1280

multi-language

1279

debuggingmedium

1250

code-review

1231

refactoring

1219

refactoringmedium

1186

from-scratchmedium

1148

from-scratchhard

1145

frontendhard

861

refactoringexpert

828

multi-languageexpert

743

from-scratcheasy

449

code-reviewhard

129

All Results

Task	Category	Score	Duration	Cost
Fix 12 WCAG accessibility violations in checkout form	frontend	68.8	2m 37s	$0.07
Fix deadlocking transaction patterns in Flask app	backend	67.6	2m 29s	$0.03
Build REST API from scratch	from-scratch	62.8	2m 16s	$0.02
Build codebase indexer for LLM context windows	from-scratch	47.1	2m 4s	$0.04
Write tests for untested legacy Flask service	code-review	51.2	2m 37s	$0.04
Zero-downtime schema migration	full-stack	81.7	1m 13s	$0.02
Debug race condition in worker pool	debugging	91.0	17.8s	<$0.01
Build distributed node cluster with gossip protocol	from-scratch	50.5	2m 18s	$0.03
Fix React hydration mismatch	frontend	82.4	1m 7s	$0.05
Fix memory leak in event handler	debugging	83.3	2m 43s	$0.07
Build production website with auth and members area	frontend	66.5	9m 25s	$0.09
Add virtual scrolling to table rendering 5000 rows	frontend	51.5	3m 14s	$0.07
Implement multi-tenant row-level security in Postgres	backend	66.2	4m 18s	$0.05
Write complex SQL report with window functions	backend	73.5	5m 6s	$0.05
Fix broken GitHub Actions CI pipeline	debugging	75.6	2m 35s	$0.06
Debug and fix 6 broken database triggers and constraints	debugging	79.3	2m 56s	$0.03
Add GraphQL layer over REST API	multi-language	72.9	2m 14s	$0.06
Fix Node.js stream backpressure causing OOM on large files	backend	85.7	2m 24s	$0.07
Replace console.log with structured logging	refactoring	55.9	1m 11s	$0.05
Add caching layer to eliminate slow SSR page loads	full-stack	87.0	1m 40s	$0.04
Fix N+1 query in dashboard	backend	66.1	1m 21s	$0.02
Add WebSocket real-time updates	full-stack	74.0	57.5s	$0.05
Add i18n with locale routing to Next.js app	full-stack	66.1	3m 26s	$0.06
Refactor monolithic handler to CQRS	refactoring	50.6	2m 44s	$0.07
Fix auth bypass vulnerability	debugging	94.1	32.2s	$0.03
Find and patch all OWASP Top 10 vulnerabilities	debugging	68.5	2m 11s	$0.04
Add streaming SSE endpoint for LLM chat	backend	81.7	43.8s	$0.03
Build real-time portfolio risk calculator	backend	57.6	5m 4s	$0.06
Implement zero-trust API authentication layer	backend	70.7	2m 13s	$0.04
Implement transformer inference engine with KV cache	from-scratch	85.8	1m 34s	$0.02
Migrate callback-hell Express app to async/await	refactoring	59.1	4m 26s	$0.07
Add file upload with S3 presigned URLs	backend	24.6	2m 60s	$0.06
Fix broken responsive layout	frontend	73.0	1m 3s	$0.03
Port Python CLI to Rust	multi-language	39.5	3m 10s	$0.05
Build RAG pipeline with vector search	backend	60.3	2m 28s	$0.03
Split 1100-line god file into proper modules	refactoring	62.2	1m 24s	$0.03
Optimize slow Postgres queries in Flask app	backend	85.3	1m 56s	$0.02
Optimize bloated React bundle under 500KB	frontend	76.8	4m 58s	$0.07
Code review: identify security vulns	code-review	45.7	2m 10s	$0.06
Build MCP server for database management	backend	71.7	1m 39s	$0.02
Harden insecure Docker setup with 12 vulnerabilities	code-review	81.0	1m 37s	$0.03
Build materialized view refresh pipeline for analytics	backend	59.5	4m 46s	$0.05
Fix race conditions in order matching engine	backend	90.7	4m 13s	$0.04
Build SaaS admin dashboard from scratch	from-scratch	38.5	4m 4s	$0.04
Build LLM evaluation harness with structured grading	backend	80.5	2m 60s	$0.03
Add Redis caching layer to Express API	backend	30.5	3m 10s	$0.07
Fix hallucination and context window bugs in RAG agent	backend	63.5	4m 49s	$0.05
Implement JWT auth middleware	backend	51.8	1m 37s	$0.06
Build terminal UI dashboard	from-scratch	59.4	2m 39s	$0.03
Write Kubernetes manifests for Node.js microservice	full-stack	75.6	40.8s	$0.03
Convert React app to PWA with offline support	frontend	10.8	44m 25s	$0.15
Remove AI slop and over-engineering from codebase	refactoring	33.3	14m 27s	$0.16
Dockerize Node.js monorepo	full-stack	64.0	6m 52s	$0.04
Implement background job scheduler with persistence	backend	60.0	4m 6s	$0.04
Build CLI tool with subcommands and config	from-scratch	42.3	3m 24s	$0.03
Fix data integrity bugs in denormalized e-commerce schema	debugging	72.7	1m 32s	$0.02
Find and fix 4 hidden backdoors in Flask app	debugging	73.7	2m 25s	$0.03
Add slash commands and moderation to Discord bot	backend	60.9	2m 21s	$0.02
Add retry logic and dead letter queue to Python task queue	backend	76.2	1m 58s	$0.02
Write integration tests for payment flow	code-review	41.5	1m 55s	$0.02
Add cursor-based pagination to REST API	backend	34.2	2m 45s	$0.03
Add rate limiting middleware	backend	80.6	1m 60s	$0.02
Implement Stripe webhook handler	backend	54.3	1m 38s	$0.02
Fix flaky test suite	debugging	74.3	1m 6s	$0.01