Engineering
Building Autoraters for Expert-Level Reasoning Data
Scale AI is one of the world’s leading suppliers of high-quality foundation model training data. In recent months we’ve seen a marked increase in demand for PhD-level, multimodal reasoning data across a multitude of domains, including math, coding, science, and humanities. Because of the ever-increasing difficulty of such expert-level data, ScaleAI invests in frontier research on quality control (QC) with LLM agents, also known as “autoraters.”
Read more
