Kimi K2.5

OpenRouter

262K context$0.45/M input$2.25/M output

1590peak 1603

Avg Score

72.1

Avg Cost

$0.13

Score/$

563.7

Runs

122

Win/Loss/Draw

Scoring Dimensions

Score Distribution

Category ELOs

backendeasy

2334

multi-languageexpert

2238

code-reviewhard

2170

multi-languagehard

2101

from-scratchexpert

2072

from-scratchmedium

2043

frontendexpert

1828

full-stackmedium

1728

frontendhard

1721

code-review

1701

full-stackhard

1700

full-stack

1686

multi-language

1684

code-reviewmedium

1678

debuggingmedium

1664

from-scratchhard

1650

from-scratch

1640

debuggingexpert

1604

debugginghard

1597

backendmedium

1580

debugging

1578

backend

1577

backendhard

1574

backendexpert

1571

frontend

1570

from-scratcheasy

1559

refactoringmedium

1552

frontendmedium

1540

frontendeasy

1538

refactoring

1524

refactoringexpert

1376

All Results

Task	Category	Score	Duration	Cost
Add Google OAuth2 login to Express app	full-stack	82.5	4m 42s	$0.10
Build LLM evaluation harness with structured grading	backend	73.8	2m 47s	$0.10
Find and patch all OWASP Top 10 vulnerabilities	debugging	69.3	1m 1s	$0.06
Write integration tests for payment flow	code-review	75.0	1m 38s	$0.11
Fix hallucination and context window bugs in RAG agent	backend	49.1	2m 26s	$0.10
Build distributed node cluster with gossip protocol	from-scratch	48.0	2m 27s	$0.08
Add i18n with locale routing to Next.js app	full-stack	74.7	1m 45s	$0.10
Implement multi-tenant row-level security in Postgres	backend	73.7	1m 15s	$0.07
Port Python CLI to Rust	multi-language	47.9	1m 49s	$0.05
Debug race condition in worker pool	debugging	89.5	25.6s	<$0.01
Build real-time portfolio risk calculator	backend	74.9	8m 50s	$0.11
Build SaaS admin dashboard from scratch	from-scratch	55.6	2m 24s	$0.11
Fix race conditions in order matching engine	backend	74.5	2m 14s	$0.08
Add cursor-based pagination to REST API	backend	80.8	1m 34s	$0.09
Fix broken responsive layout	frontend	70.1	59.6s	$0.10
Find and fix 4 hidden backdoors in Flask app	debugging	93.8	48.2s	$0.02
Convert React app to PWA with offline support	frontend	66.3	2m 41s	$0.09
Implement transformer inference engine with KV cache	from-scratch	86.0	2m 9s	$0.05
Fix N+1 query in dashboard	backend	53.4	1m 14s	$0.03
Fix deadlocking transaction patterns in Flask app	backend	77.4	1m 5s	$0.03
Add rate limiting middleware	backend	81.7	1m 30s	$0.03
Fix memory leak in event handler	debugging	81.8	1m 30s	$0.08
Add retry logic and dead letter queue to Python task queue	backend	82.9	2m 9s	$0.04
Fix Node.js stream backpressure causing OOM on large files	backend	90.3	2m 6s	$0.08
Write Kubernetes manifests for Node.js microservice	full-stack	90.2	51.8s	$0.04
Add GraphQL layer over REST API	multi-language	84.1	58.1s	$0.08
Code review: identify security vulns	code-review	79.0	2m 5s	$0.08
Zero-downtime schema migration	full-stack	76.1	29.0s	$0.02
Debug and fix 6 broken database triggers and constraints	debugging	71.9	1m 26s	$0.05
Build terminal UI dashboard	from-scratch	62.3	2m 59s	$0.07
Fix 12 WCAG accessibility violations in checkout form	frontend	84.3	1m 33s	$0.05
Build MCP server for database management	backend	84.0	1m 42s	$0.02
Fix broken GitHub Actions CI pipeline	debugging	83.3	1m 11s	$0.07
Fix auth bypass vulnerability	debugging	88.5	2m 29s	$0.07
Split 1100-line god file into proper modules	refactoring	63.8	2m 9s	$0.03
Implement JWT auth middleware	backend	53.8	1m 52s	$0.08
Optimize slow Postgres queries in Flask app	backend	78.4	2m 44s	$0.03
Add slash commands and moderation to Discord bot	backend	72.7	3m 46s	$0.07
Add file upload with S3 presigned URLs	backend	79.8	2m 9s	$0.09
Fix React hydration mismatch	frontend	83.3	1m 3s	$0.07
Add WebSocket real-time updates	full-stack	84.4	22.5s	$0.03
Build production website with auth and members area	frontend	67.1	7m 15s	$0.16
Build codebase indexer for LLM context windows	from-scratch	27.5	5m 37s	$0.11
Add virtual scrolling to table rendering 5000 rows	frontend	54.0	3m 3s	$0.07
Replace console.log with structured logging	refactoring	44.7	4m 16s	$0.08
Fix data integrity bugs in denormalized e-commerce schema	debugging	85.0	1m 22s	$0.03
Implement Stripe webhook handler	backend	84.4	1m 32s	$0.07
Harden insecure Docker setup with 12 vulnerabilities	code-review	76.3	53.9s	$0.05
Dockerize Node.js monorepo	full-stack	75.3	30.5s	$0.04
Implement zero-trust API authentication layer	backend	67.5	1m 43s	$0.10
Add streaming SSE endpoint for LLM chat	backend	81.8	39.6s	$0.08
Optimize bloated React bundle under 500KB	frontend	80.5	1m 40s	$0.11
Build materialized view refresh pipeline for analytics	backend	76.7	1m 29s	$0.08
Fix flaky test suite	debugging	87.5	44.6s	$0.03
Add caching layer to eliminate slow SSR page loads	full-stack	81.2	32.8s	$0.05
Write tests for untested legacy Flask service	code-review	53.3	3m 49s	$0.10
Build RAG pipeline with vector search	backend	49.5	2m 15s	$0.05
Remove AI slop and over-engineering from codebase	refactoring	74.8	1m 21s	$0.04
Implement background job scheduler with persistence	backend	58.0	10m 14s	$0.07
Migrate callback-hell Express app to async/await	refactoring	58.0	2m 55s	$0.12
Write complex SQL report with window functions	backend	66.8	2m 6s	$0.07
Build CLI tool with subcommands and config	from-scratch	74.5	2m 48s	$0.07
Refactor monolithic handler to CQRS	refactoring	42.6	1m 40s	$0.14
Add Redis caching layer to Express API	backend	85.2	35.4s	$0.07
Build REST API from scratch	from-scratch	77.2	54.1s	$0.02
Build codebase indexer for LLM context windows	from-scratch	31.9	8m 56s	$1.44
Harden insecure Docker setup with 12 vulnerabilities	code-review	73.2	1m 26s	$0.06
Convert React app to PWA with offline support	frontend	64.2	5m 26s	$0.70
Replace console.log with structured logging	refactoring	62.7	8m 35s	$0.87
Fix broken responsive layout	frontend	74.7	6m 51s	$0.08
Dockerize Node.js monorepo	full-stack	75.2	1m 14s	$0.08
Add caching layer to eliminate slow SSR page loads	full-stack	85.9	5m 56s	$0.54
Implement zero-trust API authentication layer	backend	71.7	8m 25s	$0.89
Implement multi-tenant row-level security in Postgres	backend	64.2	6m 15s	$0.86
Split 1100-line god file into proper modules	refactoring	88.8	4m 58s	$0.12
Optimize bloated React bundle under 500KB	frontend	74.8	9m 4s	$1.09
Remove AI slop and over-engineering from codebase	refactoring	76.8	7m 35s	$0.94
Find and patch all OWASP Top 10 vulnerabilities	debugging	75.0	1m 49s	$0.11
Implement JWT auth middleware	backend	30.3	18m 38s	$0.13
Add i18n with locale routing to Next.js app	full-stack	72.5	8m 46s	$0.67
Add file upload with S3 presigned URLs	backend	74.3	7m 19s	$0.95
Write Kubernetes manifests for Node.js microservice	full-stack	82.7	1m 34s	$0.04
Build MCP server for database management	backend	76.0	31.8s	$0.02
Implement background job scheduler with persistence	backend	71.3	4m 12s	$0.09
Build production website with auth and members area	frontend	69.6	4m 41s	$0.14
Build SaaS admin dashboard from scratch	from-scratch	73.5	1m 26s	$0.05
Implement transformer inference engine with KV cache	from-scratch	86.9	1m 17s	$0.04
Build CLI tool with subcommands and config	from-scratch	34.8	3m 22s	$0.08
Build real-time portfolio risk calculator	backend	72.1	8m 0s	$0.08
Write integration tests for payment flow	code-review	75.2	1m 37s	$0.03
Fix race conditions in order matching engine	backend	73.2	57.9s	$0.05
Debug and fix 6 broken database triggers and constraints	debugging	77.2	32.5s	$0.03
Find and fix 4 hidden backdoors in Flask app	debugging	69.7	29.1s	$0.02
Fix Node.js stream backpressure causing OOM on large files	backend	90.4	27.8s	$0.03
Add GraphQL layer over REST API	multi-language	70.7	27.4s	$0.03
Write complex SQL report with window functions	backend	81.9	49.4s	$0.04
Zero-downtime schema migration	full-stack	70.6	22.3s	$0.02
Add cursor-based pagination to REST API	backend	67.6	29.0s	$0.02
Refactor monolithic handler to CQRS	refactoring	60.5	1m 13s	$0.06
Add slash commands and moderation to Discord bot	backend	71.7	1m 18s	$0.07
Build distributed node cluster with gossip protocol	from-scratch	67.2	1m 10s	$0.05
Fix flaky test suite	debugging	83.2	17.0s	$0.01
Code review: identify security vulns	code-review	85.8	37.7s	$0.03
Fix hallucination and context window bugs in RAG agent	backend	52.0	1m 41s	$0.09
Add Redis caching layer to Express API	backend	77.8	24.4s	$0.03
Fix 12 WCAG accessibility violations in checkout form	frontend	78.9	50.3s	$0.05
Add virtual scrolling to table rendering 5000 rows	frontend	76.7	27.2s	$0.03
Write tests for untested legacy Flask service	code-review	61.5	53.2s	$0.04
Build terminal UI dashboard	from-scratch	49.5	36.5s	$0.02
Build LLM evaluation harness with structured grading	backend	54.1	44.9s	$0.04
Fix auth bypass vulnerability	debugging	92.9	17.9s	$0.01
Add rate limiting middleware	backend	63.0	34.5s	$0.03
Fix React hydration mismatch	frontend	76.2	7.3s	<$0.01
Optimize slow Postgres queries in Flask app	backend	82.7	2m 16s	$0.03
Fix deadlocking transaction patterns in Flask app	backend	71.3	31.4s	$0.03
Implement Stripe webhook handler	backend	67.8	41.6s	$0.04
Fix data integrity bugs in denormalized e-commerce schema	debugging	78.5	30.5s	$0.03
Fix memory leak in event handler	debugging	64.0	10.7s	$0.01
Build REST API from scratch	from-scratch	83.3	9.2s	<$0.01
Debug race condition in worker pool	debugging	88.4	15.2s	<$0.01
Add retry logic and dead letter queue to Python task queue	backend	74.5	1m 3s	$0.05
Fix N+1 query in dashboard	backend	89.7	13.8s	$0.01