Gemini 3.1 Pro Preview

OpenRouter

1049K context$2.00/M input$12.00/M output

1564peak 1580

Avg Score

75.3

Avg Cost

$0.53

Score/$

142.5

Runs

Win/Loss/Draw

Scoring Dimensions

Score Distribution

Category ELOs

multi-languageexpert

2331

refactoringexpert

2250

backendeasy

2245

from-scratchexpert

2157

from-scratcheasy

2012

from-scratchmedium

1912

frontendhard

1884

multi-languagehard

1738

frontendeasy

1690

from-scratch

1686

from-scratchhard

1663

multi-language

1657

full-stackmedium

1637

debuggingexpert

1621

backendhard

1611

backend

1599

debugginghard

1582

backendmedium

1578

code-reviewmedium

1575

full-stack

1574

backendexpert

1567

code-reviewhard

1555

refactoring

1544

code-review

1538

full-stackhard

1533

debugging

1487

frontend

1482

refactoringmedium

1460

frontendmedium

1418

frontendexpert

1331

debuggingmedium

989

All Results

Task	Category	Score	Duration	Cost
Replace console.log with structured logging	refactoring	68.9	4m 58s	$0.63
Build SaaS admin dashboard from scratch	from-scratch	63.6	7m 0s	$0.60
Fix Node.js stream backpressure causing OOM on large files	backend	86.3	4m 4s	$0.52
Find and patch all OWASP Top 10 vulnerabilities	debugging	69.7	3m 15s	$0.50
Build LLM evaluation harness with structured grading	backend	81.7	2m 59s	$0.25
Find and fix 4 hidden backdoors in Flask app	debugging	90.7	1m 13s	$0.12
Fix React hydration mismatch	frontend	71.1	1m 7s	$0.29
Implement background job scheduler with persistence	backend	79.7	4m 26s	$0.43
Implement multi-tenant row-level security in Postgres	backend	80.3	3m 7s	$0.40
Write complex SQL report with window functions	backend	78.1	3m 22s	$0.29
Fix broken responsive layout	frontend	78.0	2m 18s	$0.49
Write tests for untested legacy Flask service	code-review	49.9	7m 22s	$0.70
Build codebase indexer for LLM context windows	from-scratch	54.8	8m 58s	$0.71
Implement Stripe webhook handler	backend	81.2	1m 31s	$0.22
Build CLI tool with subcommands and config	from-scratch	82.5	3m 53s	$0.32
Fix race conditions in order matching engine	backend	91.8	4m 27s	$0.35
Add streaming SSE endpoint for LLM chat	backend	87.7	1m 41s	$0.31
Split 1100-line god file into proper modules	refactoring	61.3	2m 21s	$0.29
Debug and fix 6 broken database triggers and constraints	debugging	90.0	2m 29s	$0.22
Build terminal UI dashboard	from-scratch	70.5	3m 16s	$0.24
Migrate callback-hell Express app to async/await	refactoring	65.0	7m 16s	$0.91
Fix 12 WCAG accessibility violations in checkout form	frontend	85.5	2m 36s	$0.41
Code review: identify security vulns	code-review	83.2	1m 19s	$0.17
Fix memory leak in event handler	debugging	48.9	5m 26s	$0.63
Fix auth bypass vulnerability	debugging	92.1	56.0s	$0.19
Zero-downtime schema migration	full-stack	82.8	1m 42s	$0.15
Add WebSocket real-time updates	full-stack	84.2	3m 41s	$0.62
Build real-time portfolio risk calculator	backend	65.0	10m 52s	$0.83
Add retry logic and dead letter queue to Python task queue	backend	88.3	4m 16s	$0.31
Optimize slow Postgres queries in Flask app	backend	85.0	2m 45s	$0.25
Add cursor-based pagination to REST API	backend	79.2	1m 42s	$0.27
Build distributed node cluster with gossip protocol	from-scratch	69.9	5m 17s	$0.42
Build production website with auth and members area	frontend	64.6	9m 29s	$0.79
Fix data integrity bugs in denormalized e-commerce schema	debugging	84.2	3m 58s	$0.36
Add rate limiting middleware	backend	87.5	2m 6s	$0.19
Remove AI slop and over-engineering from codebase	refactoring	85.8	1m 10s	$0.22
Add caching layer to eliminate slow SSR page loads	full-stack	89.2	1m 8s	$0.25
Add Redis caching layer to Express API	backend	46.5	5m 6s	$0.72
Fix broken GitHub Actions CI pipeline	debugging	67.5	6m 3s	$0.69
Add GraphQL layer over REST API	multi-language	78.5	7m 3s	$1.25
Port Python CLI to Rust	multi-language	76.5	8m 28s	$3.24
Build RAG pipeline with vector search	backend	78.3	3m 8s	$0.47
Add file upload with S3 presigned URLs	backend	44.3	6m 7s	$1.24
Implement zero-trust API authentication layer	backend	67.7	5m 13s	$1.12
Add i18n with locale routing to Next.js app	full-stack	35.8	1m 36s	$0.12
Implement JWT auth middleware	backend	69.0	3m 4s	$0.57
Write Kubernetes manifests for Node.js microservice	full-stack	93.8	1m 10s	$0.13
Convert React app to PWA with offline support	frontend	63.4	3m 55s	$1.18
Optimize bloated React bundle under 500KB	frontend	76.6	7m 29s	$2.81
Dockerize Node.js monorepo	full-stack	63.5	3m 57s	$2.04
Harden insecure Docker setup with 12 vulnerabilities	code-review	87.2	3m 35s	$0.79
Fix deadlocking transaction patterns in Flask app	backend	57.1	1m 15s	$0.14
Implement transformer inference engine with KV cache	from-scratch	89.8	3m 9s	$0.35
Build MCP server for database management	backend	86.1	1m 30s	$0.17
Fix hallucination and context window bugs in RAG agent	backend	64.5	3m 13s	$0.34
Build materialized view refresh pipeline for analytics	backend	66.3	3m 40s	$0.40
Add virtual scrolling to table rendering 5000 rows	frontend	80.5	4m 52s	$0.26
Add Google OAuth2 login to Express app	full-stack	76.0	1m 41s	$0.20
Add slash commands and moderation to Discord bot	backend	85.1	2m 14s	$0.24
Write integration tests for payment flow	code-review	74.7	3m 15s	$0.33
Refactor monolithic handler to CQRS	refactoring	80.5	2m 48s	$0.30
Fix flaky test suite	debugging	63.8	1m 8s	$0.12
Fix N+1 query in dashboard	backend	90.6	1m 33s	$0.16
Debug race condition in worker pool	debugging	87.0	51.6s	$0.08
Build REST API from scratch	from-scratch	86.3	23.0s	$0.04