GLM 4.7

Z.ai

200K context$0.60/M input$2.20/M output

1574peak 1588

Avg Score

71.5

Avg Cost

$0.10

Score/$

705.7

Runs

124

Win/Loss/Draw

Scoring Dimensions

Score Distribution

Category ELOs

backendeasy

2534

refactoringexpert

2244

multi-languagehard

2110

from-scratchexpert

2072

code-reviewmedium

1881

from-scratchmedium

1870

frontendexpert

1764

full-stackhard

1737

frontendhard

1722

full-stack

1642

debuggingmedium

1635

frontendmedium

1628

code-review

1620

backendmedium

1613

frontend

1608

debugginghard

1605

refactoring

1600

debuggingexpert

1578

backend

1572

debugging

1566

backendhard

1558

refactoringmedium

1556

from-scratch

1545

multi-language

1530

backendexpert

1521

frontendeasy

1521

from-scratchhard

1490

full-stackmedium

1471

from-scratcheasy

1373

code-reviewhard

1367

multi-languageexpert

1207

All Results

Task	Category	Score	Duration	Cost
Port Python CLI to Rust	multi-language	34.1	6m 50s	$0.07
Build real-time portfolio risk calculator	backend	52.1	7m 7s	$0.07
Replace console.log with structured logging	refactoring	51.0	5m 33s	$0.09
Implement multi-tenant row-level security in Postgres	backend	71.5	3m 17s	$0.05
Add GraphQL layer over REST API	multi-language	79.2	2m 1s	$0.07
Add rate limiting middleware	backend	83.5	2m 15s	$0.03
Implement zero-trust API authentication layer	backend	76.4	2m 32s	$0.06
Build distributed node cluster with gossip protocol	from-scratch	44.6	3m 12s	$0.05
Build LLM evaluation harness with structured grading	backend	36.0	2m 27s	$0.04
Add Redis caching layer to Express API	backend	82.2	3m 8s	$0.09
Split 1100-line god file into proper modules	refactoring	66.2	1m 35s	$0.05
Add WebSocket real-time updates	full-stack	76.1	1m 20s	$0.06
Add file upload with S3 presigned URLs	backend	55.3	2m 57s	$0.08
Write integration tests for payment flow	code-review	73.8	5m 32s	$0.11
Fix race conditions in order matching engine	backend	75.3	3m 34s	$0.05
Build REST API from scratch	from-scratch	75.8	1m 19s	$0.02
Fix deadlocking transaction patterns in Flask app	backend	72.5	2m 8s	$0.02
Debug race condition in worker pool	debugging	90.4	14.4s	<$0.01
Zero-downtime schema migration	full-stack	82.8	47.4s	$0.01
Add retry logic and dead letter queue to Python task queue	backend	79.1	2m 54s	$0.03
Build SaaS admin dashboard from scratch	from-scratch	44.4	7m 55s	$0.07
Implement transformer inference engine with KV cache	from-scratch	86.8	2m 58s	$0.03
Write tests for untested legacy Flask service	code-review	64.1	7m 14s	$0.08
Remove AI slop and over-engineering from codebase	refactoring	77.2	47.0s	$0.03
Build terminal UI dashboard	from-scratch	57.9	5m 15s	$0.06
Write complex SQL report with window functions	backend	60.6	4m 11s	$0.06
Build materialized view refresh pipeline for analytics	backend	70.3	2m 35s	$0.03
Fix flaky test suite	debugging	88.8	1m 34s	$0.02
Optimize bloated React bundle under 500KB	frontend	74.2	2m 20s	$0.05
Optimize slow Postgres queries in Flask app	backend	86.3	1m 2s	$0.01
Fix hallucination and context window bugs in RAG agent	backend	55.9	6m 11s	$0.07
Fix broken responsive layout	frontend	74.2	1m 38s	$0.04
Code review: identify security vulns	code-review	25.9	1m 44s	$0.07
Find and patch all OWASP Top 10 vulnerabilities	debugging	66.8	2m 12s	$0.05
Migrate callback-hell Express app to async/await	refactoring	61.2	1m 8s	$0.04
Build CLI tool with subcommands and config	from-scratch	48.3	5m 38s	$0.07
Dockerize Node.js monorepo	full-stack	73.9	1m 12s	$0.04
Add virtual scrolling to table rendering 5000 rows	frontend	53.6	3m 0s	$0.08
Convert React app to PWA with offline support	frontend	80.6	1m 39s	$0.04
Fix 12 WCAG accessibility violations in checkout form	frontend	83.8	2m 40s	$0.04
Find and fix 4 hidden backdoors in Flask app	debugging	74.8	1m 24s	$0.02
Fix broken GitHub Actions CI pipeline	debugging	81.7	3m 5s	$0.07
Fix React hydration mismatch	frontend	74.3	31.7s	$0.06
Implement JWT auth middleware	backend	56.5	2m 29s	$0.08
Add Google OAuth2 login to Express app	full-stack	78.8	1m 56s	$0.07
Build MCP server for database management	backend	76.4	3m 4s	$0.04
Fix Node.js stream backpressure causing OOM on large files	backend	85.9	1m 51s	$0.07
Add cursor-based pagination to REST API	backend	78.5	2m 9s	$0.07
Debug and fix 6 broken database triggers and constraints	debugging	90.7	1m 28s	$0.03
Add caching layer to eliminate slow SSR page loads	full-stack	81.2	1m 6s	$0.05
Add i18n with locale routing to Next.js app	full-stack	73.2	3m 18s	$0.08
Fix data integrity bugs in denormalized e-commerce schema	debugging	87.5	1m 37s	$0.03
Build production website with auth and members area	frontend	63.6	7m 28s	$0.12
Fix auth bypass vulnerability	debugging	89.7	1m 49s	$0.07
Add streaming SSE endpoint for LLM chat	backend	87.5	2m 34s	$0.09
Refactor monolithic handler to CQRS	refactoring	87.6	2m 52s	$0.08
Implement Stripe webhook handler	backend	82.0	1m 4s	$0.06
Harden insecure Docker setup with 12 vulnerabilities	code-review	87.3	1m 16s	$0.04
Build RAG pipeline with vector search	backend	67.1	1m 36s	$0.03
Fix N+1 query in dashboard	backend	66.4	1m 21s	$0.02
Add slash commands and moderation to Discord bot	backend	77.6	2m 12s	$0.04
Build codebase indexer for LLM context windows	from-scratch	52.7	4m 43s	$0.08
Write Kubernetes manifests for Node.js microservice	full-stack	82.4	44.1s	$0.03
Fix memory leak in event handler	debugging	49.7	2m 26s	$0.08
Implement background job scheduler with persistence	backend	62.7	3m 21s	$0.07
Build materialized view refresh pipeline for analytics	backend	76.5	7m 22s	$0.75
Code review: identify security vulns	code-review	82.6	35.7s	$0.02
Add WebSocket real-time updates	full-stack	79.4	4m 34s	$0.30
Build codebase indexer for LLM context windows	from-scratch	40.9	16m 59s	$0.90
Implement multi-tenant row-level security in Postgres	backend	72.8	14m 60s	$0.60
Convert React app to PWA with offline support	frontend	70.7	6m 35s	$0.26
Add i18n with locale routing to Next.js app	full-stack	67.3	10m 55s	$0.37
Implement zero-trust API authentication layer	backend	78.4	23m 41s	$0.71
Write Kubernetes manifests for Node.js microservice	full-stack	76.3	9m 59s	$0.23
Remove AI slop and over-engineering from codebase	refactoring	90.1	15m 3s	$0.40
Replace console.log with structured logging	refactoring	43.4	9m 27s	$0.29
Split 1100-line god file into proper modules	refactoring	76.3	9m 29s	$0.58
Optimize bloated React bundle under 500KB	frontend	71.2	9m 51s	$0.72
Find and patch all OWASP Top 10 vulnerabilities	debugging	67.8	5m 47s	$0.61
Add caching layer to eliminate slow SSR page loads	full-stack	76.7	8m 52s	$0.40
Add file upload with S3 presigned URLs	backend	71.0	10m 35s	$0.30
Fix broken responsive layout	frontend	69.1	7m 4s	$0.23
Implement JWT auth middleware	backend	72.3	3m 40s	$0.13
Harden insecure Docker setup with 12 vulnerabilities	code-review	80.3	4m 23s	$0.14
Dockerize Node.js monorepo	full-stack	66.5	2m 28s	$0.16
Build production website with auth and members area	frontend	63.2	3m 57s	$0.06
Build SaaS admin dashboard from scratch	from-scratch	54.1	4m 35s	$0.04
Implement background job scheduler with persistence	backend	66.6	2m 13s	$0.04
Implement transformer inference engine with KV cache	from-scratch	87.4	4m 46s	$0.02
Build MCP server for database management	backend	79.0	3m 55s	$0.02
Build CLI tool with subcommands and config	from-scratch	66.0	1m 34s	$0.02
Build LLM evaluation harness with structured grading	backend	48.9	3m 20s	$0.05
Fix hallucination and context window bugs in RAG agent	backend	64.4	2m 11s	$0.04
Fix data integrity bugs in denormalized e-commerce schema	debugging	78.5	39.6s	$0.01
Build terminal UI dashboard	from-scratch	66.1	1m 42s	$0.03
Fix Node.js stream backpressure causing OOM on large files	backend	86.3	39.2s	$0.02
Add retry logic and dead letter queue to Python task queue	backend	81.2	8m 32s	$0.03
Build REST API from scratch	from-scratch	79.8	50.5s	<$0.01
Add rate limiting middleware	backend	73.2	57.2s	$0.02
Implement Stripe webhook handler	backend	77.5	1m 38s	$0.02
Fix race conditions in order matching engine	backend	35.5	3m 13s	$0.05
Fix deadlocking transaction patterns in Flask app	backend	69.5	1m 55s	$0.03
Build distributed node cluster with gossip protocol	from-scratch	56.7	1m 20s	$0.02
Fix auth bypass vulnerability	debugging	93.7	14.4s	<$0.01
Fix memory leak in event handler	debugging	64.0	9.8s	<$0.01
Add slash commands and moderation to Discord bot	backend	74.1	1m 34s	$0.03
Zero-downtime schema migration	full-stack	63.1	31.3s	<$0.01
Add virtual scrolling to table rendering 5000 rows	frontend	82.2	1m 46s	$0.04
Find and fix 4 hidden backdoors in Flask app	debugging	90.4	38.4s	$0.01
Add Google OAuth2 login to Express app	full-stack	77.5	49.2s	$0.02
Fix React hydration mismatch	frontend	75.2	25.7s	<$0.01
Fix N+1 query in dashboard	backend	82.5	29.0s	<$0.01
Debug and fix 6 broken database triggers and constraints	debugging	80.0	2m 21s	$0.03
Add Redis caching layer to Express API	backend	79.3	3m 21s	$0.02
Fix flaky test suite	debugging	82.0	1m 23s	$0.02
Write complex SQL report with window functions	backend	71.9	1m 4s	$0.02
Write integration tests for payment flow	code-review	59.0	1m 52s	$0.02
Refactor monolithic handler to CQRS	refactoring	72.3	1m 11s	$0.02
Debug race condition in worker pool	debugging	80.5	9.5s	<$0.01
Build real-time portfolio risk calculator	backend	65.5	5m 18s	$0.06
Fix 12 WCAG accessibility violations in checkout form	frontend	84.1	2m 21s	$0.04
Optimize slow Postgres queries in Flask app	backend	82.0	1m 13s	$0.02
Add cursor-based pagination to REST API	backend	74.5	47.7s	$0.02
Add GraphQL layer over REST API	multi-language	81.3	33.9s	$0.02