GLM 4.7

Z.ai

200K context$0.60/M input$2.20/M output

1499peak 1604

Avg Score

72.0

Avg Cost

$0.07

Score/$

1059.1

Runs

Win/Loss/Draw

Scoring Dimensions

Score Distribution

Category ELOs

refactoringexpert

2542

from-scratchexpert

2076

backendeasy

1959

multi-languagehard

1812

frontendhard

1677

debuggingexpert

1614

full-stackhard

1602

debuggingmedium

1585

code-reviewmedium

1573

from-scratchmedium

1565

backendmedium

1559

debugging

1547

debugginghard

1541

refactoring

1538

code-review

1529

frontendexpert

1527

full-stack

1523

frontendmedium

1523

frontend

1517

backend

1496

backendhard

1488

code-reviewhard

1433

from-scratch

1431

refactoringmedium

1414

full-stackmedium

1409

frontendeasy

1385

backendexpert

1365

multi-language

1338

from-scratchhard

1313

from-scratcheasy

1241

multi-languageexpert

227

All Results

Task	Category	Score	Duration	Cost
Port Python CLI to Rust	multi-language	34.1	6m 50s	$0.07
Build real-time portfolio risk calculator	backend	52.1	7m 7s	$0.07
Replace console.log with structured logging	refactoring	51.0	5m 33s	$0.09
Implement multi-tenant row-level security in Postgres	backend	71.5	3m 17s	$0.05
Add GraphQL layer over REST API	multi-language	79.2	2m 1s	$0.07
Add rate limiting middleware	backend	83.5	2m 15s	$0.03
Implement zero-trust API authentication layer	backend	76.4	2m 32s	$0.06
Build distributed node cluster with gossip protocol	from-scratch	56.2	3m 12s	$0.05
Build LLM evaluation harness with structured grading	backend	36.0	2m 27s	$0.04
Add Redis caching layer to Express API	backend	82.2	3m 8s	$0.09
Split 1100-line god file into proper modules	refactoring	66.2	1m 35s	$0.05
Add WebSocket real-time updates	full-stack	79.4	4m 34s	$0.30
Add file upload with S3 presigned URLs	backend	55.3	2m 57s	$0.08
Write integration tests for payment flow	code-review	73.8	5m 32s	$0.11
Fix race conditions in order matching engine	backend	75.3	3m 34s	$0.05
Build REST API from scratch	from-scratch	75.8	1m 19s	$0.02
Fix deadlocking transaction patterns in Flask app	backend	72.5	2m 8s	$0.02
Debug race condition in worker pool	debugging	90.4	14.4s	<$0.01
Zero-downtime schema migration	full-stack	82.8	47.4s	$0.01
Add retry logic and dead letter queue to Python task queue	backend	79.1	2m 54s	$0.03
Build SaaS admin dashboard from scratch	from-scratch	44.4	7m 55s	$0.07
Implement transformer inference engine with KV cache	from-scratch	86.8	2m 58s	$0.03
Write tests for untested legacy Flask service	code-review	64.1	7m 14s	$0.08
Remove AI slop and over-engineering from codebase	refactoring	77.2	47.0s	$0.03
Build terminal UI dashboard	from-scratch	61.1	5m 15s	$0.06
Write complex SQL report with window functions	backend	60.6	4m 11s	$0.06
Build materialized view refresh pipeline for analytics	backend	76.5	7m 22s	$0.75
Fix flaky test suite	debugging	88.8	1m 34s	$0.02
Optimize bloated React bundle under 500KB	frontend	74.2	2m 20s	$0.05
Optimize slow Postgres queries in Flask app	backend	86.3	1m 2s	$0.01
Fix hallucination and context window bugs in RAG agent	backend	55.9	6m 11s	$0.07
Fix broken responsive layout	frontend	74.2	1m 38s	$0.04
Code review: identify security vulns	code-review	82.6	35.7s	$0.02
Find and patch all OWASP Top 10 vulnerabilities	debugging	66.8	2m 12s	$0.05
Migrate callback-hell Express app to async/await	refactoring	61.2	1m 8s	$0.04
Build CLI tool with subcommands and config	from-scratch	55.9	5m 38s	$0.07
Dockerize Node.js monorepo	full-stack	73.9	1m 12s	$0.04
Add virtual scrolling to table rendering 5000 rows	frontend	53.6	3m 0s	$0.08
Convert React app to PWA with offline support	frontend	80.6	1m 39s	$0.04
Fix 12 WCAG accessibility violations in checkout form	frontend	83.8	2m 40s	$0.04
Find and fix 4 hidden backdoors in Flask app	debugging	74.8	1m 24s	$0.02
Fix broken GitHub Actions CI pipeline	debugging	81.7	3m 5s	$0.07
Fix React hydration mismatch	frontend	74.3	31.7s	$0.06
Implement JWT auth middleware	backend	56.5	2m 29s	$0.08
Add Google OAuth2 login to Express app	full-stack	78.8	1m 56s	$0.07
Build MCP server for database management	backend	76.4	3m 4s	$0.04
Fix Node.js stream backpressure causing OOM on large files	backend	85.9	1m 51s	$0.07
Add cursor-based pagination to REST API	backend	78.5	2m 9s	$0.07
Debug and fix 6 broken database triggers and constraints	debugging	90.7	1m 28s	$0.03
Add caching layer to eliminate slow SSR page loads	full-stack	81.2	1m 6s	$0.05
Add i18n with locale routing to Next.js app	full-stack	73.2	3m 18s	$0.08
Fix data integrity bugs in denormalized e-commerce schema	debugging	87.5	1m 37s	$0.03
Build production website with auth and members area	frontend	63.6	7m 28s	$0.12
Fix auth bypass vulnerability	debugging	89.7	1m 49s	$0.07
Add streaming SSE endpoint for LLM chat	backend	87.5	2m 34s	$0.09
Refactor monolithic handler to CQRS	refactoring	87.6	2m 52s	$0.08
Implement Stripe webhook handler	backend	82.0	1m 4s	$0.06
Harden insecure Docker setup with 12 vulnerabilities	code-review	87.3	1m 16s	$0.04
Build RAG pipeline with vector search	backend	67.1	1m 36s	$0.03
Fix N+1 query in dashboard	backend	66.4	1m 21s	$0.02
Add slash commands and moderation to Discord bot	backend	77.6	2m 12s	$0.04
Build codebase indexer for LLM context windows	from-scratch	52.7	4m 43s	$0.08
Write Kubernetes manifests for Node.js microservice	full-stack	82.4	44.1s	$0.03
Fix memory leak in event handler	debugging	49.7	2m 26s	$0.08
Implement background job scheduler with persistence	backend	62.7	3m 21s	$0.07