Nemotron 3 Nano 30b A3b

OpenRouter

262K context$0.05/M input$0.20/M output

1241peak 1258

Avg Score

52.0

Avg Cost

$0.09

Score/$

582.6

Runs

120

Win/Loss/Draw

Scoring Dimensions

Score Distribution

Category ELOs

refactoringexpert

1559

debugginghard

1432

debuggingexpert

1429

debugging

1418

debuggingmedium

1403

from-scratcheasy

1373

backendmedium

1334

refactoring

1316

frontendmedium

1314

full-stackmedium

1305

refactoringmedium

1268

full-stack

1245

backend

1244

frontend

1203

full-stackhard

1188

backendexpert

1173

frontendeasy

1126

backendhard

1121

code-reviewmedium

1103

code-review

1091

frontendexpert

1074

multi-language

1054

from-scratch

1046

backendeasy

923

from-scratchhard

843

multi-languageexpert

761

code-reviewhard

669

multi-languagehard

495

from-scratchmedium

from-scratchexpert

frontendhard

All Results

Task	Category	Score	Duration	Cost
Build REST API from scratch	from-scratch	42.2	38.4s	<$0.01
Add caching layer to eliminate slow SSR page loads	full-stack	65.1	5m 2s	$0.02
Implement background job scheduler with persistence	backend	23.8	6m 58s	$0.02
Find and fix 4 hidden backdoors in Flask app	debugging	57.4	1m 16s	<$0.01
Fix hallucination and context window bugs in RAG agent	backend	56.3	1m 56s	<$0.01
Implement transformer inference engine with KV cache	from-scratch	31.0	4m 13s	<$0.01
Build terminal UI dashboard	from-scratch	31.8	2m 52s	<$0.01
Write tests for untested legacy Flask service	code-review	34.9	1m 49s	<$0.01
Find and patch all OWASP Top 10 vulnerabilities	debugging	60.3	1m 8s	<$0.01
Build codebase indexer for LLM context windows	from-scratch	31.6	2m 44s	<$0.01
Build production website with auth and members area	frontend	53.8	3m 45s	<$0.01
Build LLM evaluation harness with structured grading	backend	34.3	2m 49s	<$0.01
Split 1100-line god file into proper modules	refactoring	69.2	32.5s	<$0.01
Build real-time portfolio risk calculator	backend	37.6	2m 14s	<$0.01
Add WebSocket real-time updates	full-stack	65.0	45.6s	<$0.01
Write complex SQL report with window functions	backend	55.1	4m 52s	<$0.01
Fix auth bypass vulnerability	debugging	68.3	45.6s	<$0.01
Dockerize Node.js monorepo	full-stack	70.5	38.6s	<$0.01
Add Redis caching layer to Express API	backend	56.1	47.3s	<$0.01
Fix flaky test suite	debugging	84.4	1m 22s	<$0.01
Implement zero-trust API authentication layer	backend	65.1	1m 30s	<$0.01
Optimize bloated React bundle under 500KB	frontend	59.3	2m 25s	<$0.01
Build materialized view refresh pipeline for analytics	backend	55.4	2m 24s	<$0.01
Write Kubernetes manifests for Node.js microservice	full-stack	84.3	18.3s	<$0.01
Code review: identify security vulns	code-review	57.1	35.2s	<$0.01
Add streaming SSE endpoint for LLM chat	backend	67.3	42.9s	<$0.01
Fix memory leak in event handler	debugging	80.7	20.7s	<$0.01
Fix race conditions in order matching engine	backend	60.0	2m 32s	<$0.01
Debug race condition in worker pool	debugging	76.8	8.9s	<$0.01
Add i18n with locale routing to Next.js app	full-stack	56.4	8m 35s	$0.03
Fix data integrity bugs in denormalized e-commerce schema	debugging	88.1	3m 57s	<$0.01
Implement JWT auth middleware	backend	43.8	48.7s	<$0.01
Implement multi-tenant row-level security in Postgres	backend	35.5	3m 57s	$0.01
Fix deadlocking transaction patterns in Flask app	backend	68.9	53.3s	<$0.01
Migrate callback-hell Express app to async/await	refactoring	59.0	1m 35s	<$0.01
Add cursor-based pagination to REST API	backend	68.7	48.6s	<$0.01
Add virtual scrolling to table rendering 5000 rows	frontend	32.3	23.9s	<$0.01
Fix broken responsive layout	frontend	60.1	46.7s	<$0.01
Replace console.log with structured logging	refactoring	44.4	2m 10s	<$0.01
Optimize slow Postgres queries in Flask app	backend	68.7	39.1s	<$0.01
Implement Stripe webhook handler	backend	64.0	1m 21s	<$0.01
Add Google OAuth2 login to Express app	full-stack	61.1	1m 5s	<$0.01
Add slash commands and moderation to Discord bot	backend	56.8	1m 48s	<$0.01
Build CLI tool with subcommands and config	from-scratch	23.5	4m 50s	<$0.01
Remove AI slop and over-engineering from codebase	refactoring	74.0	36.1s	<$0.01
Debug and fix 6 broken database triggers and constraints	debugging	67.8	1m 20s	<$0.01
Build SaaS admin dashboard from scratch	from-scratch	28.8	4m 53s	<$0.01
Add file upload with S3 presigned URLs	backend	84.1	1m 23s	<$0.01
Add rate limiting middleware	backend	34.9	3m 28s	<$0.01
Zero-downtime schema migration	full-stack	67.2	37.8s	<$0.01
Port Python CLI to Rust	multi-language	24.8	7m 4s	$0.01
Convert React app to PWA with offline support	frontend	60.9	1m 8s	<$0.01
Fix 12 WCAG accessibility violations in checkout form	frontend	42.9	2m 52s	<$0.01
Fix broken GitHub Actions CI pipeline	debugging	73.2	4m 17s	$0.01
Add retry logic and dead letter queue to Python task queue	backend	77.3	1m 3s	<$0.01
Harden insecure Docker setup with 12 vulnerabilities	code-review	72.4	33.1s	<$0.01
Write integration tests for payment flow	code-review	66.0	29.7s	<$0.01
Build RAG pipeline with vector search	backend	31.7	3m 42s	<$0.01
Refactor monolithic handler to CQRS	refactoring	75.0	1m 5s	<$0.01
Build distributed node cluster with gossip protocol	from-scratch	16.2	4m 16s	<$0.01
Fix React hydration mismatch	frontend	75.2	33.8s	<$0.01
Build MCP server for database management	backend	33.1	3m 58s	<$0.01
Fix Node.js stream backpressure causing OOM on large files	backend	66.8	24.5s	<$0.01
Fix N+1 query in dashboard	backend	37.7	30.1s	<$0.01
Add GraphQL layer over REST API	multi-language	54.3	39.1s	<$0.01
Split 1100-line god file into proper modules	refactoring	11.8	13m 15s	$0.53
Harden insecure Docker setup with 12 vulnerabilities	code-review	5.8	9m 5s	$0.41
Remove AI slop and over-engineering from codebase	refactoring	14.8	8m 36s	$0.73
Optimize bloated React bundle under 500KB	frontend	38.0	6m 40s	$0.61
Add caching layer to eliminate slow SSR page loads	full-stack	53.3	8m 50s	$0.51
Fix broken responsive layout	frontend	40.5	8m 54s	$0.93
Implement JWT auth middleware	backend	54.5	3m 52s	$0.51
Add i18n with locale routing to Next.js app	full-stack	34.4	17m 16s	$0.93
Replace console.log with structured logging	refactoring	3.2	10m 2s	$1.15
Find and patch all OWASP Top 10 vulnerabilities	debugging	31.1	4m 44s	$0.54
Implement multi-tenant row-level security in Postgres	backend	48.5	5m 31s	$0.64
Implement zero-trust API authentication layer	backend	55.3	5m 47s	$0.37
Build codebase indexer for LLM context windows	from-scratch	2.8	13m 18s	$0.68
Dockerize Node.js monorepo	full-stack	50.0	13m 41s	$0.61
Write Kubernetes manifests for Node.js microservice	full-stack	75.4	5m 1s	$0.36
Convert React app to PWA with offline support	frontend	36.4	6m 47s	$0.70
Implement transformer inference engine with KV cache	from-scratch	40.8	15m 22s	$0.02
Build production website with auth and members area	frontend	34.0	3m 37s	<$0.01
Build MCP server for database management	backend	43.3	3m 26s	<$0.01
Implement background job scheduler with persistence	backend	22.6	1m 53s	<$0.01
Build SaaS admin dashboard from scratch	from-scratch	35.2	3m 52s	<$0.01
Fix race conditions in order matching engine	backend	72.7	3m 53s	<$0.01
Build CLI tool with subcommands and config	from-scratch	34.3	1m 24s	<$0.01
Write complex SQL report with window functions	backend	47.0	4m 24s	<$0.01
Fix hallucination and context window bugs in RAG agent	backend	61.3	1m 8s	<$0.01
Build real-time portfolio risk calculator	backend	45.5	2m 8s	<$0.01
Build LLM evaluation harness with structured grading	backend	28.5	58.4s	<$0.01
Fix data integrity bugs in denormalized e-commerce schema	debugging	63.3	1m 38s	<$0.01
Find and fix 4 hidden backdoors in Flask app	debugging	77.8	1m 36s	<$0.01
Fix deadlocking transaction patterns in Flask app	backend	48.5	58.1s	<$0.01
Debug and fix 6 broken database triggers and constraints	debugging	72.3	56.7s	<$0.01
Add Redis caching layer to Express API	backend	52.6	36.9s	<$0.01
Add rate limiting middleware	backend	63.5	4m 42s	<$0.01
Write tests for untested legacy Flask service	code-review	40.2	1m 1s	<$0.01
Optimize slow Postgres queries in Flask app	backend	56.3	1m 6s	<$0.01
Add slash commands and moderation to Discord bot	backend	35.5	1m 31s	<$0.01
Refactor monolithic handler to CQRS	refactoring	44.8	4m 21s	<$0.01
Fix 12 WCAG accessibility violations in checkout form	frontend	43.8	1m 15s	<$0.01
Add retry logic and dead letter queue to Python task queue	backend	69.8	51.6s	<$0.01
Add virtual scrolling to table rendering 5000 rows	frontend	31.0	42.0s	<$0.01
Build distributed node cluster with gossip protocol	from-scratch	18.3	59.6s	<$0.01
Fix Node.js stream backpressure causing OOM on large files	backend	90.3	20.9s	<$0.01
Add GraphQL layer over REST API	multi-language	41.4	1m 1s	<$0.01
Fix auth bypass vulnerability	debugging	94.7	46.8s	<$0.01
Write integration tests for payment flow	code-review	46.3	57.1s	<$0.01
Implement Stripe webhook handler	backend	54.1	1m 27s	<$0.01
Fix flaky test suite	debugging	82.5	1m 16s	<$0.01
Zero-downtime schema migration	full-stack	53.1	41.4s	<$0.01
Add cursor-based pagination to REST API	backend	29.8	50.3s	<$0.01
Build terminal UI dashboard	from-scratch	31.9	1m 16s	<$0.01
Fix React hydration mismatch	frontend	80.3	15.1s	<$0.01
Fix N+1 query in dashboard	backend	63.4	28.7s	<$0.01
Build REST API from scratch	from-scratch	80.2	20.6s	<$0.01
Fix memory leak in event handler	debugging	61.3	14.5s	<$0.01
Debug race condition in worker pool	debugging	58.0	16.8s	<$0.01