GLM 4.6

Z.ai

200K context$0.60/M input$2.20/M output

1441peak 1451

Avg Score

64.1

Avg Cost

$0.11

Score/$

575.0

Runs

123

Win/Loss/Draw

Scoring Dimensions

Score Distribution

Category ELOs

multi-languageexpert

1924

from-scratchexpert

1733

frontendexpert

1691

multi-language

1686

multi-languagehard

1656

frontendhard

1590

frontendeasy

1555

debuggingexpert

1550

debugginghard

1536

from-scratchhard

1523

code-reviewmedium

1512

frontend

1484

full-stackmedium

1480

refactoringmedium

1477

code-review

1472

backendexpert

1463

debugging

1462

full-stack

1461

full-stackhard

1451

backendmedium

1431

refactoring

1428

frontendmedium

1424

from-scratch

1411

backend

1405

code-reviewhard

1395

backendhard

1372

debuggingmedium

1191

from-scratchmedium

1151

from-scratcheasy

1052

refactoringexpert

680

backendeasy

115

All Results

Task	Category	Score	Duration	Cost
Remove AI slop and over-engineering from codebase	refactoring	45.0	1m 22s	$0.06
Add Redis caching layer to Express API	backend	72.3	1m 14s	$0.07
Find and patch all OWASP Top 10 vulnerabilities	debugging	71.1	1m 2s	$0.04
Add Google OAuth2 login to Express app	full-stack	72.8	1m 29s	$0.06
Convert React app to PWA with offline support	frontend	70.7	1m 20s	$0.04
Implement background job scheduler with persistence	backend	41.1	1m 52s	$0.04
Build distributed node cluster with gossip protocol	from-scratch	28.0	1m 13s	$0.01
Build LLM evaluation harness with structured grading	backend	36.4	4m 37s	$0.07
Build RAG pipeline with vector search	backend	44.6	43.4s	$0.02
Add WebSocket real-time updates	full-stack	78.2	1m 56s	$0.05
Fix React hydration mismatch	frontend	84.5	36.4s	$0.06
Build production website with auth and members area	frontend	58.5	5m 38s	$0.08
Debug race condition in worker pool	debugging	87.3	9.5s	<$0.01
Write complex SQL report with window functions	backend	76.1	2m 46s	$0.04
Build codebase indexer for LLM context windows	from-scratch	50.6	2m 10s	$0.03
Fix data integrity bugs in denormalized e-commerce schema	debugging	86.1	27.0s	<$0.01
Fix auth bypass vulnerability	debugging	89.5	34.5s	$0.05
Fix 12 WCAG accessibility violations in checkout form	frontend	80.4	1m 8s	$0.04
Implement Stripe webhook handler	backend	73.0	36.6s	$0.06
Optimize slow Postgres queries in Flask app	backend	52.0	1m 23s	$0.03
Debug and fix 6 broken database triggers and constraints	debugging	59.6	48.2s	$0.02
Implement multi-tenant row-level security in Postgres	backend	65.5	45.6s	$0.03
Fix broken GitHub Actions CI pipeline	debugging	76.8	36.6s	$0.06
Build terminal UI dashboard	from-scratch	51.1	1m 5s	$0.02
Add rate limiting middleware	backend	37.6	49.1s	$0.02
Add i18n with locale routing to Next.js app	full-stack	69.0	2m 10s	$0.06
Build MCP server for database management	backend	76.8	44.1s	$0.02
Fix broken responsive layout	frontend	69.1	23.7s	$0.04
Add cursor-based pagination to REST API	backend	81.6	45.7s	$0.06
Write tests for untested legacy Flask service	code-review	34.8	1m 44s	$0.04
Fix deadlocking transaction patterns in Flask app	backend	71.9	46.3s	$0.01
Build real-time portfolio risk calculator	backend	62.6	1m 30s	$0.04
Fix race conditions in order matching engine	backend	59.3	1m 42s	$0.04
Write integration tests for payment flow	code-review	75.3	2m 27s	$0.08
Fix hallucination and context window bugs in RAG agent	backend	65.1	2m 22s	$0.04
Add caching layer to eliminate slow SSR page loads	full-stack	82.0	37.7s	$0.04
Zero-downtime schema migration	full-stack	65.3	38.1s	$0.02
Build materialized view refresh pipeline for analytics	backend	50.4	45.1s	$0.02
Fix flaky test suite	debugging	51.2	37.7s	$0.01
Add retry logic and dead letter queue to Python task queue	backend	57.8	1m 5s	$0.02
Split 1100-line god file into proper modules	refactoring	63.4	1m 36s	$0.04
Add streaming SSE endpoint for LLM chat	backend	80.5	1m 14s	$0.06
Add slash commands and moderation to Discord bot	backend	63.2	57.5s	$0.02
Build SaaS admin dashboard from scratch	from-scratch	47.3	2m 32s	$0.05
Migrate callback-hell Express app to async/await	refactoring	55.7	1m 53s	$0.08
Optimize bloated React bundle under 500KB	frontend	61.2	1m 35s	$0.05
Harden insecure Docker setup with 12 vulnerabilities	code-review	75.1	26.0s	$0.03
Build CLI tool with subcommands and config	from-scratch	44.4	1m 33s	$0.04
Find and fix 4 hidden backdoors in Flask app	debugging	78.0	35.7s	$0.02
Implement zero-trust API authentication layer	backend	68.5	1m 52s	$0.05
Add virtual scrolling to table rendering 5000 rows	frontend	42.1	37.7s	$0.06
Fix Node.js stream backpressure causing OOM on large files	backend	85.5	35.1s	$0.06
Build REST API from scratch	from-scratch	73.4	45.2s	$0.01
Dockerize Node.js monorepo	full-stack	71.8	26.6s	$0.03
Add file upload with S3 presigned URLs	backend	51.4	1m 17s	$0.07
Replace console.log with structured logging	refactoring	55.7	1m 17s	$0.07
Fix memory leak in event handler	debugging	74.5	33.7s	$0.06
Write Kubernetes manifests for Node.js microservice	full-stack	85.8	39.2s	$0.03
Port Python CLI to Rust	multi-language	65.5	59.6s	$0.02
Implement transformer inference engine with KV cache	from-scratch	80.7	24.6s	<$0.01
Code review: identify security vulns	code-review	72.4	53.5s	$0.06
Refactor monolithic handler to CQRS	refactoring	45.8	1m 4s	$0.06
Fix N+1 query in dashboard	backend	56.5	25.1s	<$0.01
Implement JWT auth middleware	backend	41.5	1m 3s	$0.06
Write tests for untested legacy Flask service	code-review	41.1	19m 59s	$1.92
Add WebSocket real-time updates	full-stack	75.8	3m 55s	$0.23
Port Python CLI to Rust	multi-language	46.7	7m 10s	$0.61
Implement multi-tenant row-level security in Postgres	backend	67.2	3m 14s	$0.44
Add file upload with S3 presigned URLs	backend	63.1	6m 60s	$1.60
Split 1100-line god file into proper modules	refactoring	72.2	4m 50s	$0.56
Find and patch all OWASP Top 10 vulnerabilities	debugging	67.8	12m 41s	$1.12
Implement JWT auth middleware	backend	66.0	4m 12s	$0.19
Dockerize Node.js monorepo	full-stack	68.4	2m 5s	$0.16
Add caching layer to eliminate slow SSR page loads	full-stack	71.1	4m 17s	$0.30
Implement zero-trust API authentication layer	backend	56.8	7m 26s	$0.66
Add i18n with locale routing to Next.js app	full-stack	67.8	4m 2s	$0.32
Fix broken responsive layout	frontend	75.1	2m 56s	$0.07
Remove AI slop and over-engineering from codebase	refactoring	87.0	3m 49s	$0.49
Convert React app to PWA with offline support	frontend	43.3	4m 15s	$0.40
Harden insecure Docker setup with 12 vulnerabilities	code-review	88.5	4m 13s	$0.10
Write Kubernetes manifests for Node.js microservice	full-stack	77.8	3m 49s	$0.09
Build codebase indexer for LLM context windows	from-scratch	26.8	7m 23s	$0.49
Replace console.log with structured logging	refactoring	47.8	5m 30s	$0.40
Optimize bloated React bundle under 500KB	frontend	62.7	7m 31s	$0.47
Build CLI tool with subcommands and config	from-scratch	55.9	1m 18s	$0.02
Implement background job scheduler with persistence	backend	26.5	9.2s	<$0.01
Build MCP server for database management	backend	74.8	25.0s	$0.01
Implement transformer inference engine with KV cache	from-scratch	47.9	21.1s	<$0.01
Build SaaS admin dashboard from scratch	from-scratch	62.9	1m 11s	$0.03
Build production website with auth and members area	frontend	67.2	2m 47s	$0.06
Fix deadlocking transaction patterns in Flask app	backend	59.8	27.1s	$0.01
Fix race conditions in order matching engine	backend	74.7	1m 20s	$0.02
Write complex SQL report with window functions	backend	72.1	45.0s	$0.02
Build real-time portfolio risk calculator	backend	53.5	1m 2s	$0.02
Fix data integrity bugs in denormalized e-commerce schema	debugging	50.6	30.3s	$0.01
Build LLM evaluation harness with structured grading	backend	64.2	1m 44s	$0.03
Debug and fix 6 broken database triggers and constraints	debugging	57.4	19.0s	<$0.01
Implement Stripe webhook handler	backend	56.9	10.2s	<$0.01
Add Redis caching layer to Express API	backend	76.5	27.7s	$0.01
Find and fix 4 hidden backdoors in Flask app	debugging	92.1	23.3s	<$0.01
Add virtual scrolling to table rendering 5000 rows	frontend	73.0	24.1s	<$0.01
Add GraphQL layer over REST API	multi-language	72.8	27.9s	<$0.01
Fix auth bypass vulnerability	debugging	92.9	11.0s	<$0.01
Fix flaky test suite	debugging	58.2	10.5s	<$0.01
Fix Node.js stream backpressure causing OOM on large files	backend	80.5	13.2s	<$0.01
Fix memory leak in event handler	debugging	60.3	6.6s	<$0.01
Fix N+1 query in dashboard	backend	62.0	9.5s	<$0.01
Fix React hydration mismatch	frontend	68.0	6.2s	<$0.01
Code review: identify security vulns	code-review	60.3	59.0s	<$0.01
Debug race condition in worker pool	debugging	82.3	7.5s	<$0.01
Optimize slow Postgres queries in Flask app	backend	53.6	38.3s	$0.01
Add slash commands and moderation to Discord bot	backend	73.1	34.8s	$0.01
Add cursor-based pagination to REST API	backend	71.1	10.8s	<$0.01
Fix hallucination and context window bugs in RAG agent	backend	72.5	1m 42s	$0.03
Build REST API from scratch	from-scratch	73.9	17.8s	<$0.01
Build terminal UI dashboard	from-scratch	51.0	31.0s	<$0.01
Add rate limiting middleware	backend	42.8	12.5s	<$0.01
Write integration tests for payment flow	code-review	69.5	36.5s	$0.02
Fix 12 WCAG accessibility violations in checkout form	frontend	80.7	43.7s	$0.02
Zero-downtime schema migration	full-stack	58.0	13.5s	<$0.01
Build distributed node cluster with gossip protocol	from-scratch	58.1	51.0s	$0.01
Add retry logic and dead letter queue to Python task queue	backend	54.0	17.8s	<$0.01
Refactor monolithic handler to CQRS	refactoring	48.6	23.1s	$0.01