Since its inception in 2023, Outlier has become a cornerstone of the AI industry—connecting hundreds of thousands of people across the globe with meaningful and flexible work. Hailing from cities and small towns across the world, Outlier contributors have earned a combined hundreds of millions of dollars to help build the foundation of today’s most advanced AI models

Frontier AI development has reached an inflection point: as models rapidly advance in capabilities, the need for sophisticated evaluation has become a decisive factor in competitive success. That’s why today we're announcing updates to Scale Evaluation, our platform that helps teams identify model weaknesses and validate improvements. Our updated platform introduces four key capabilities: instant model comparison across thousands of tests, multi-dimensional performance visualization, automated error discovery, and targeted improvement guidance—all designed to help teams identify weaknesses faster and make more confident release decisions. These updates build on Scale Evaluation’s foundation introduced last year, broadening access to frontier evaluation capabilities.

Scale AI products have been approved for purchase on AWS Marketplace for the U.S. Intelligence Community (ICMP). ICMP is a digital catalog that makes it easy for customers in the U.S. national security community to find, test, buy, and deploy software that runs on AWS.

The next four years will be critical to the future of AI leadership around the world and the case for bold action has never been clearer. More than one year ago the United States was leading the world in the development of AI systems, but today that is no longer the case. Chinese AI advancements, most notably with the launch of Deepsek, have shown that China has closed the gap and now the race is nearly tied. It is not enough for the United States to match China’s intensity on AI, we must exceed it or simply put, we lose. President Trump rightly called Deepseek’s release “a wake up call” and now, the US needs to heed the call to action and determine how to best respond in order to win. 

Scale is proud to have been awarded a prime contract by the Defense Innovation Unit (DIU) for Thunderforge - the DoD’s flagship program leveraging AI for military planning and wargaming. Thunderforge represents our commitment to advancing U.S. military capabilities. Following its initial deployment, Thunderforge will expand throughout combatant commands, leveraging Scale AI's agentic applications and GenAI evaluation expertise.

Scale AI, a leader in building frontier AI solutions, and Inception, a G42 company developing AI-native products for enterprises, have announced a strategic partnership aimed at accelerating global AI adoption across the public and private sector. The partnership agreement was signed between Ashish Koshy, COO of Inception and Trevor Thompson, Global Managing Director at Scale AI.

Scale AI, in collaboration with the Center for Strategic and International Studies (CSIS), is proud to introduce the Critical Foreign Policy Decision (CFPD) Benchmark—a pioneering effort to evaluate large language models (LLMs) on national security and foreign policy decision-making tendencies.

The Ministry of Communications and Information Technology (MCIT) and Scale AI, the leader in frontier AI solutions, are announcing a strategic, long-term partnership to drive Qatar’s digital transformation.

Contested basing environments require scalable solutions for perimeter security. Scale AI, the Defense Innovation Unit, and the U.S. Air Force are demonstrating the value of computer vision to force protection challenges globally.

Scale researchers have discovered a groundbreaking method for AI safety testing called J2 (Jailbreaking to Jailbreak), where language models are taught to systematically test their own and other models' safety measures. This hybrid approach combines human-like strategic reasoning with automated scalability, achieving success rates of over 90% in vulnerability testing, nearly matching professional human red-teaming effectiveness. While highlighting significant advances in automated security testing, these findings also reveal important challenges for the future of AI safety.