Grok 4.1 Fast

OpenRouter

2000K context$0.20/M input$0.50/M output

1473

Avg Score

65.8

Avg Cost

$0.02

Score/$

4128.3

Runs

Win/Loss/Draw

Scoring Dimensions

Score Distribution

Category ELOs

from-scratcheasy

1807

debuggingexpert

1668

debugginghard

1654

debugging

1603

frontendhard

1570

debuggingmedium

1563

backendmedium

1560

from-scratchexpert

1548

from-scratchmedium

1515

full-stackhard

1501

backend

1486

multi-languagehard

1485

full-stack

1477

frontendmedium

1474

code-reviewmedium

1468

backendeasy

1467

frontend

1466

backendexpert

1464

from-scratch

1462

full-stackmedium

1434

frontendeasy

1433

backendhard

1431

code-review

1418

from-scratchhard

1386

multi-language

1301

frontendexpert

1300

refactoring

1289

refactoringmedium

1280

code-reviewhard

1199

refactoringexpert

906

multi-languageexpert

706

All Results

Task	Category	Score	Duration	Cost
Implement background job scheduler with persistence	backend	3.9	7m 32s	$0.02
Build SaaS admin dashboard from scratch	from-scratch	23.8	2m 34s	$0.01
Build CLI tool with subcommands and config	from-scratch	10.0	2m 5s	<$0.01
Fix N+1 query in dashboard	backend	63.5	2m 51s	<$0.01
Fix flaky test suite	debugging	93.2	1m 9s	<$0.01
Debug and fix 6 broken database triggers and constraints	debugging	90.8	1m 53s	<$0.01
Write complex SQL report with window functions	backend	70.5	2m 26s	$0.01
Find and patch all OWASP Top 10 vulnerabilities	debugging	69.7	2m 28s	$0.01
Dockerize Node.js monorepo	full-stack	71.1	1m 4s	$0.01
Optimize slow Postgres queries in Flask app	backend	82.0	1m 46s	<$0.01
Find and fix 4 hidden backdoors in Flask app	debugging	93.5	50.7s	<$0.01
Add i18n with locale routing to Next.js app	full-stack	64.7	3m 17s	$0.02
Implement JWT auth middleware	backend	45.1	59.9s	$0.02
Build real-time portfolio risk calculator	backend	64.0	7m 22s	$0.02
Code review: identify security vulns	code-review	82.9	33.4s	$0.02
Fix data integrity bugs in denormalized e-commerce schema	debugging	89.3	58.3s	<$0.01
Write Kubernetes manifests for Node.js microservice	full-stack	87.5	27.4s	<$0.01
Fix React hydration mismatch	frontend	78.3	3m 2s	$0.02
Build terminal UI dashboard	from-scratch	66.3	2m 31s	<$0.01
Write integration tests for payment flow	code-review	40.7	1m 36s	$0.02
Add Google OAuth2 login to Express app	full-stack	82.5	3m 30s	$0.03
Add slash commands and moderation to Discord bot	backend	63.4	3m 7s	$0.01
Fix Node.js stream backpressure causing OOM on large files	backend	80.1	1m 47s	$0.02
Write tests for untested legacy Flask service	code-review	35.0	5m 19s	$0.02
Build REST API from scratch	from-scratch	67.7	1m 5s	<$0.01
Fix broken GitHub Actions CI pipeline	debugging	74.5	2m 21s	$0.03
Fix hallucination and context window bugs in RAG agent	backend	86.4	1m 3s	<$0.01
Add rate limiting middleware	backend	74.0	2m 48s	$0.01
Build distributed node cluster with gossip protocol	from-scratch	41.5	2m 31s	<$0.01
Implement transformer inference engine with KV cache	from-scratch	70.8	5m 43s	$0.02
Add Redis caching layer to Express API	backend	62.4	3m 33s	$0.03
Build materialized view refresh pipeline for analytics	backend	54.5	4m 58s	$0.02
Port Python CLI to Rust	multi-language	41.0	7m 10s	$0.02
Implement zero-trust API authentication layer	backend	32.5	2m 8s	$0.01
Build MCP server for database management	backend	88.2	1m 35s	<$0.01
Convert React app to PWA with offline support	frontend	71.8	1m 15s	$0.01
Fix broken responsive layout	frontend	75.3	1m 49s	$0.02
Replace console.log with structured logging	refactoring	62.7	2m 50s	$0.02
Fix memory leak in event handler	debugging	75.6	1m 51s	$0.02
Add WebSocket real-time updates	full-stack	67.3	49.7s	<$0.01
Add cursor-based pagination to REST API	backend	70.8	5m 56s	$0.03
Add retry logic and dead letter queue to Python task queue	backend	81.3	3m 43s	<$0.01
Build codebase indexer for LLM context windows	from-scratch	38.2	4m 11s	$0.02
Build production website with auth and members area	frontend	60.5	3m 20s	$0.02
Fix 12 WCAG accessibility violations in checkout form	frontend	74.7	3m 42s	$0.03
Implement Stripe webhook handler	backend	77.5	2m 32s	$0.02
Add caching layer to eliminate slow SSR page loads	full-stack	57.1	1m 37s	$0.02
Add GraphQL layer over REST API	multi-language	75.8	3m 8s	$0.02
Remove AI slop and over-engineering from codebase	refactoring	68.9	45.4s	<$0.01
Add streaming SSE endpoint for LLM chat	backend	84.4	2m 49s	$0.02
Migrate callback-hell Express app to async/await	refactoring	54.9	4m 13s	$0.03
Add file upload with S3 presigned URLs	backend	82.5	3m 2s	$0.03
Split 1100-line god file into proper modules	refactoring	58.1	43.2s	$0.01
Refactor monolithic handler to CQRS	refactoring	57.4	1m 52s	$0.02
Debug race condition in worker pool	debugging	93.7	33.5s	<$0.01
Build RAG pipeline with vector search	backend	31.4	2m 9s	<$0.01
Fix race conditions in order matching engine	backend	78.1	3m 1s	$0.01
Fix deadlocking transaction patterns in Flask app	backend	68.8	1m 31s	<$0.01
Fix auth bypass vulnerability	debugging	71.7	5m 47s	$0.03
Implement multi-tenant row-level security in Postgres	backend	42.3	1m 36s	$0.01
Optimize bloated React bundle under 500KB	frontend	76.2	1m 55s	$0.02
Harden insecure Docker setup with 12 vulnerabilities	code-review	77.6	1m 54s	$0.02
Zero-downtime schema migration	full-stack	73.0	46.6s	<$0.01
Build LLM evaluation harness with structured grading	backend	79.5	1m 11s	<$0.01
Add virtual scrolling to table rendering 5000 rows	frontend	43.0	2m 46s	$0.02