Claude Haiku 4.5

Anthropic

128K context<$0.01/M input<$0.01/M output

1553peak 1557

Avg Score

71.1

Avg Cost

$0.07

Score/$

973.6

Runs

Win/Loss/Draw

Scoring Dimensions

Score Distribution

Category ELOs

multi-languagehard

2110

backendeasy

2098

from-scratcheasy

2011

multi-languageexpert

1994

refactoringexpert

1984

code-reviewhard

1967

multi-language

1871

refactoringmedium

1811

refactoring

1789

code-reviewmedium

1780

code-review

1756

full-stackmedium

1727

from-scratchhard

1711

frontendhard

1705

full-stack

1672

debuggingmedium

1669

full-stackhard

1652

frontendexpert

1641

backendhard

1608

from-scratch

1601

frontendeasy

1572

debugginghard

1567

debugging

1526

debuggingexpert

1496

backend

1470

frontend

1469

backendmedium

1391

frontendmedium

1364

backendexpert

1336

from-scratchmedium

1229

from-scratchexpert

406

All Results

Task	Category	Score	Duration	Cost
Build SaaS admin dashboard from scratch	from-scratch	68.1	10m 35s	$0.05
Add retry logic and dead letter queue to Python task queue	backend	60.9	3m 22s	$0.09
Build RAG pipeline with vector search	backend	74.3	4m 53s	$0.07
Write tests for untested legacy Flask service	code-review	82.8	2m 53s	$0.11
Build distributed node cluster with gossip protocol	from-scratch	53.5	1m 60s	$0.05
Add Google OAuth2 login to Express app	full-stack	66.0	4m 22s	$0.10
Migrate callback-hell Express app to async/await	refactoring	84.9	3m 6s	$0.11
Build terminal UI dashboard	from-scratch	55.0	3m 4s	$0.06
Build materialized view refresh pipeline for analytics	backend	63.9	5m 12s	$0.11
Zero-downtime schema migration	full-stack	87.8	1m 27s	$0.04
Add Redis caching layer to Express API	backend	56.0	3m 57s	$0.09
Implement background job scheduler with persistence	backend	48.2	3m 36s	$0.09
Port Python CLI to Rust	multi-language	69.9	4m 1s	$0.09
Fix broken GitHub Actions CI pipeline	debugging	95.0	41.4s	$0.02
Add rate limiting middleware	backend	84.9	2m 43s	$0.10
Add GraphQL layer over REST API	multi-language	80.2	1m 52s	$0.04
Code review: identify security vulns	code-review	79.3	1m 36s	$0.04
Fix race conditions in order matching engine	backend	87.2	2m 6s	$0.06
Build MCP server for database management	backend	87.3	1m 20s	$0.04
Add file upload with S3 presigned URLs	backend	71.8	9m 50s	$0.25
Replace console.log with structured logging	refactoring	74.6	6m 53s	$0.13
Add streaming SSE endpoint for LLM chat	backend	23.0	5m 53s	$0.07
Split 1100-line god file into proper modules	refactoring	81.0	4m 40s	$0.12
Implement multi-tenant row-level security in Postgres	backend	5.0	1m 17s	$0.04
Optimize bloated React bundle under 500KB	frontend	72.2	12m 42s	<$0.01
Find and patch all OWASP Top 10 vulnerabilities	debugging	73.7	5m 45s	$0.13
Add i18n with locale routing to Next.js app	full-stack	75.0	4m 60s	$0.13
Implement JWT auth middleware	backend	83.4	1m 26s	$0.03
Convert React app to PWA with offline support	frontend	80.1	1m 34s	$0.04
Build codebase indexer for LLM context windows	from-scratch	81.9	3m 47s	$0.09
Fix broken responsive layout	frontend	76.9	1m 22s	$0.04
Add caching layer to eliminate slow SSR page loads	full-stack	87.5	1m 45s	$0.05
Write Kubernetes manifests for Node.js microservice	full-stack	84.6	1m 49s	$0.05
Harden insecure Docker setup with 12 vulnerabilities	code-review	92.8	1m 5s	$0.03
Dockerize Node.js monorepo	full-stack	83.8	1m 7s	$0.02
Implement zero-trust API authentication layer	backend	45.8	1m 5s	$0.03
Remove AI slop and over-engineering from codebase	refactoring	88.4	3m 6s	$0.11
Implement transformer inference engine with KV cache	from-scratch	53.8	3m 48s	$0.08
Build production website with auth and members area	frontend	65.7	8m 5s	$0.20
Build CLI tool with subcommands and config	from-scratch	75.0	4m 43s	$0.14
Write integration tests for payment flow	code-review	70.3	10m 55s	$0.22
Build LLM evaluation harness with structured grading	backend	40.5	5m 25s	$0.17
Refactor monolithic handler to CQRS	refactoring	72.8	3m 41s	$0.11
Fix hallucination and context window bugs in RAG agent	backend	75.4	2m 16s	$0.06
Build real-time portfolio risk calculator	backend	52.5	3m 34s	$0.11
Fix data integrity bugs in denormalized e-commerce schema	debugging	50.8	3m 53s	$0.13
Write complex SQL report with window functions	backend	78.5	1m 39s	$0.07
Fix deadlocking transaction patterns in Flask app	backend	73.9	1m 16s	$0.04
Debug and fix 6 broken database triggers and constraints	debugging	84.0	55.0s	$0.03
Find and fix 4 hidden backdoors in Flask app	debugging	92.5	59.5s	$0.03
Optimize slow Postgres queries in Flask app	backend	74.3	1m 14s	$0.04
Add slash commands and moderation to Discord bot	backend	54.9	57.3s	$0.03
Fix 12 WCAG accessibility violations in checkout form	frontend	83.2	2m 47s	$0.10
Add virtual scrolling to table rendering 5000 rows	frontend	62.8	1m 20s	$0.08
Fix Node.js stream backpressure causing OOM on large files	backend	81.0	37.2s	$0.02
Fix auth bypass vulnerability	debugging	92.1	42.9s	$0.02
Fix flaky test suite	debugging	79.5	1m 7s	$0.02
Implement Stripe webhook handler	backend	59.4	35.4s	$0.01
Add cursor-based pagination to REST API	backend	62.6	1m 13s	$0.23
Fix N+1 query in dashboard	backend	63.8	46.3s	$0.02
Add WebSocket real-time updates	full-stack	60.6	45.8s	$0.02
Fix memory leak in event handler	debugging	60.4	20.7s	<$0.01
Debug race condition in worker pool	debugging	87.3	33.3s	$0.01
Fix React hydration mismatch	frontend	56.2	30.4s	<$0.01
Build REST API from scratch	from-scratch	90.9	1m 7s	$0.01