GPT 5.2

OpenRouter

400K context$1.75/M input$14.00/M output

1717

Avg Score

78.5

Avg Cost

$0.17

Score/$

461.4

Runs

Win/Loss/Draw

Scoring Dimensions

Score Distribution

Category ELOs

frontendexpert

2423

from-scratchexpert

2203

multi-languagehard

2139

backendeasy

2131

code-reviewhard

2130

frontendhard

2031

full-stackmedium

1993

refactoringexpert

1990

from-scratcheasy

1979

frontendmedium

1911

backendexpert

1861

from-scratchmedium

1861

from-scratchhard

1854

full-stack

1828

frontend

1828

backendmedium

1820

from-scratch

1806

full-stackhard

1756

backend

1753

debuggingmedium

1753

debuggingexpert

1685

refactoring

1667

code-review

1657

backendhard

1651

debugging

1645

refactoringmedium

1640

debugginghard

1637

code-reviewmedium

1624

multi-language

1525

frontendeasy

1461

multi-languageexpert

634

All Results

Task	Category	Score	Duration	Cost
Debug race condition in worker pool	debugging	92.1	6.4s	<$0.01
Add caching layer to eliminate slow SSR page loads	full-stack	79.7	2m 7s	$0.16
Write complex SQL report with window functions	backend	77.0	3m 23s	$0.26
Add slash commands and moderation to Discord bot	backend	86.3	2m 8s	$0.14
Remove AI slop and over-engineering from codebase	refactoring	90.5	51.2s	$0.07
Write Kubernetes manifests for Node.js microservice	full-stack	92.2	43.5s	$0.06
Build SaaS admin dashboard from scratch	from-scratch	63.6	5m 18s	$0.40
Fix hallucination and context window bugs in RAG agent	backend	63.0	3m 49s	$0.23
Build codebase indexer for LLM context windows	from-scratch	59.3	4m 7s	$0.28
Fix deadlocking transaction patterns in Flask app	backend	85.0	1m 14s	$0.08
Optimize bloated React bundle under 500KB	frontend	82.1	3m 50s	$0.27
Fix memory leak in event handler	debugging	91.8	1m 26s	$0.11
Debug and fix 6 broken database triggers and constraints	debugging	93.3	1m 37s	$0.09
Build real-time portfolio risk calculator	backend	86.1	2m 10s	$0.15
Replace console.log with structured logging	refactoring	69.0	2m 24s	$0.17
Add i18n with locale routing to Next.js app	full-stack	76.5	3m 17s	$0.23
Build LLM evaluation harness with structured grading	backend	82.3	1m 51s	$0.12
Add Redis caching layer to Express API	backend	90.1	2m 28s	$0.17
Build materialized view refresh pipeline for analytics	backend	76.5	3m 5s	$0.21
Refactor monolithic handler to CQRS	refactoring	51.1	1m 31s	$0.13
Build MCP server for database management	backend	86.9	1m 10s	$0.07
Fix 12 WCAG accessibility violations in checkout form	frontend	90.2	3m 40s	$0.24
Implement background job scheduler with persistence	backend	72.2	4m 15s	$0.30
Fix Node.js stream backpressure causing OOM on large files	backend	91.2	3m 29s	$0.25
Optimize slow Postgres queries in Flask app	backend	83.0	1m 51s	$0.13
Add retry logic and dead letter queue to Python task queue	backend	78.6	2m 25s	$0.16
Find and patch all OWASP Top 10 vulnerabilities	debugging	75.1	3m 39s	$0.24
Write tests for untested legacy Flask service	code-review	70.4	2m 30s	$0.16
Build distributed node cluster with gossip protocol	from-scratch	83.7	2m 56s	$0.19
Add file upload with S3 presigned URLs	backend	84.4	3m 59s	$0.26
Fix N+1 query in dashboard	backend	74.7	51.3s	$0.05
Add virtual scrolling to table rendering 5000 rows	frontend	60.5	1m 34s	$0.13
Add cursor-based pagination to REST API	backend	88.0	3m 2s	$0.21
Build CLI tool with subcommands and config	from-scratch	72.3	2m 29s	$0.19
Fix race conditions in order matching engine	backend	84.8	1m 28s	$0.09
Build RAG pipeline with vector search	backend	48.3	2m 25s	$0.16
Fix flaky test suite	debugging	92.8	41.9s	$0.04
Port Python CLI to Rust	multi-language	40.5	3m 36s	$0.22
Migrate callback-hell Express app to async/await	refactoring	68.0	2m 5s	$0.14
Fix broken GitHub Actions CI pipeline	debugging	87.6	1m 56s	$0.13
Fix broken responsive layout	frontend	76.0	1m 19s	$0.13
Add Google OAuth2 login to Express app	full-stack	88.1	3m 46s	$0.25
Dockerize Node.js monorepo	full-stack	76.7	1m 38s	$0.11
Find and fix 4 hidden backdoors in Flask app	debugging	81.7	47.9s	$0.06
Build production website with auth and members area	frontend	72.5	10m 53s	$0.85
Zero-downtime schema migration	full-stack	88.3	36.7s	$0.04
Fix auth bypass vulnerability	debugging	88.3	2m 16s	$0.15
Implement transformer inference engine with KV cache	from-scratch	91.5	56.4s	$0.07
Harden insecure Docker setup with 12 vulnerabilities	code-review	94.2	1m 57s	$0.13
Add rate limiting middleware	backend	77.9	1m 50s	$0.11
Split 1100-line god file into proper modules	refactoring	64.4	1m 19s	$0.09
Implement multi-tenant row-level security in Postgres	backend	64.7	7m 2s	$0.47
Add GraphQL layer over REST API	multi-language	87.0	3m 27s	$0.24
Fix data integrity bugs in denormalized e-commerce schema	debugging	65.9	3m 2s	$0.20
Add streaming SSE endpoint for LLM chat	backend	88.5	2m 41s	$0.19
Implement zero-trust API authentication layer	backend	78.7	3m 9s	$0.23
Implement JWT auth middleware	backend	50.9	1m 35s	$0.13
Fix React hydration mismatch	frontend	85.8	50.0s	$0.07
Implement Stripe webhook handler	backend	88.0	1m 2s	$0.09
Code review: identify security vulns	code-review	78.5	1m 22s	$0.12
Add WebSocket real-time updates	full-stack	78.5	41.0s	$0.06
Write integration tests for payment flow	code-review	84.3	2m 59s	$0.22
Build REST API from scratch	from-scratch	76.5	52.9s	$0.05
Build terminal UI dashboard	from-scratch	72.9	2m 24s	$0.16
Convert React app to PWA with offline support	frontend	84.7	1m 52s	$0.13