Scale AI Research
Scale AI’s mission is to accelerate the development of AI applications. By advancing research, we aim to create AI systems capable of solving complex, human-level problems.
Beyond Seeing: Evaluating Multimodal LLMs On Tool-enabled Image Perception, Transformation, and Reasoning
October 15, 2025
Safety, Evaluation and Alignment
Reasoning
Multimodal
Read More
Online Rubrics Elicitation from Pairwise Comparisons
October 8, 2025
Safety, Evaluation and Alignment
Post-Training
Read More
Chasing the Tail: Effective Rubric-based Reward Modeling for Large Language Model Post-Training
September 25, 2025
Post-Training
Science of Data
Read More
SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
September 19, 2025
Agents
Safety, Evaluation and Alignment
Read More
TutorBench: A Benchmark To Assess Tutoring Capabilities Of Large Language Models
September 11, 2025
Safety, Evaluation and Alignment
Read More
Reliable Weak-to-Strong Monitoring of LLM Agents
August 26, 2025
Safety, Evaluation and Alignment
Oversight
Read More
Search-Time Data Contamination
August 13, 2025
Safety, Evaluation and Alignment
Oversight
Read More
MultiNRC: A Challenging and Native Multilingual Reasoning Evaluation Benchmark for LLMs
July 23, 2025
Reasoning
Safety, Evaluation and Alignment
Read More
Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domains
July 23, 2025
Science of Data
Post-Training
Read More
News
Blog
Advancing Safe and Reliable AI: Scale's Research in Post-Training, Reasoning, and Evaluation
Research
Humanity's Last Exam
Blog
The New ChatGPT-4o Update Promises Better Writing, How Does It Compare To The New Claude 3.5 Sonnet?
Blog
First Impressions of OpenAI’s o1
Blog
Submit Your Toughest Questions for Humanity's Last Exam
Blog
Scale's SEAL Research Lab Launches Expert-Evaluated LLM Leaderboards