Scale AI Blog

Matthew Siegel

Deployment Lessons from Global Governments

SWE Atlas is Complete: Measuring Coding Agents Across the Engineering Loop

HiL-Bench: Your Agent is Smart. It Just Won't Ask for Help.

Voice Showdown: The First Arena for Voice AI

Testing & Evals

Testing & Evals

Can Coding Agents Become Engineers? We’re Finding Out.

MoReBench: Evaluating the Process of AI Moral Reasoning

Crumbling Under Pressure: PropensityBench Reveals AI’s Weaknesses

The Remote Labor Index: Measuring the Automation of Work

Enterprise Reinforcement Learning with Rubrics as Rewards

Smoothing Out LLM Variance for Reliable Enterprise Evals

TutorBench: Grading the Next Generation of AI Tutors

Using Rubrics to Build Better Models

AI Doesn’t Live in Text Alone

New Benchmarks Envision the Future of AI in Healthcare

The AI Risk Matrix: Evolving AI Safety and Security for Today

The Future is Multilingual: Scale's New Evaluation Benchmark

I’m Afraid I Can’t Let You Do That

Testing & Evals

Testing & Evals

The Future of AI Learning Environments: Verifiable Reward + Multi-Agent Interaction