Penn Jenks

Machine Learning Research Engineer

<p dir="ltr">Language models provide impressive general capabilities off the shelf, but because they were not trained on private enterprise data they fall short of delivering the specialized performance enterprises need for their unique workflows, internal systems, and proprietary data. At Scale, our Safety, Evaluations and Alignment Lab (SEAL) recently published <a href="https://scale.com/blog/future-ai-learning">foundational reinforcement learning research</a>, and our enterprise team is pioneering new approaches to solve this challenge through cutting-edge reinforcement learning research focused on training AI agents specifically for enterprise environments.</p>
<h2 dir="ltr">Beyond AI Workflow Automation: A Scalable Agent Training Framework</h2>
<p dir="ltr">Traditional enterprise AI implementations rely on workflow-based agents that require engineers to hand-craft specialized logic for each customer problem. This approach is inherently unscalable as it's time-intensive, brittle, and demands specialized resources like applied AI engineers for every new use case. Additionally, prompt engineering can only take agent performance so far &mdash; simply adding context via prompting can never replace letting agents &ldquo;<a href="https://storage.googleapis.com/deepmind-media/Era-of-Experience%20/The%20Era%20of%20Experience%20Paper.pdf">learn continually from their own experience</a>&rdquo;. Scale's research takes a more general and scalable approach: instead of engineering solutions, we train agents to learn the decision-making required to solve each task through reinforcement learning with verifiable rewards and tool integration.</p>
<p dir="ltr">Our technique lies in training agents that can autonomously decide which tools to use and how to use them, whether that's analyzing proprietary documents, conducting web searches, or executing complex coding tasks. We go beyond the capabilities available in commercial LLM APIs by leveraging reinforcement learning with enterprise-specific tools in the training loop. We're creating agents that learn to solve problems and make correct decisions using the specific responses from tools (traditionally known as observations in RL), rather than following pre-programmed workflows.&nbsp;</p>
<p dir="ltr">We build on <a href="https://scale.com/research/rubrics_as_rewards">research</a> conducted by SEAL showing that we can also leverage rubrics for problems that are not easily verifiable&mdash;i.e., they lack an unambiguous ground truth. Early results demonstrate that our reinforcement learning approach with tools and verifiable rewards significantly outperforms traditional supervised fine-tuning methods, leading to absolute accuracy boosts as high as 31% with RL vs. 12% with SFT on an internal tool-required benchmark.</p>
<h2 dir="ltr">Delivering Enterprise-Specific Performance at Scale</h2>
<p dir="ltr">We're actively implementing these capabilities with enterprise data across multiple domains: document analysis for specialized fields, determining outcomes for critical legal reasoning, web search agents, and complex mathematical and coding reasoning tasks. Our training methodology teaches agents to implicitly learn tool usage patterns, requiring only prompts and verifiable outcomes.</p>
<p dir="ltr">Our experienced MLEs work with our customer's subject matter experts to design the best implementation of reinforcement learning for each specific task, implement 'reward crafting' including deep rubric-building expertise for specialized domains, create novel environments for agent training on enterprise-specific tasks, and build infrastructure for long-running asynchronous agents.</p>
<p dir="ltr">While other companies focus on general-purpose models, Scale is developing multi-agent training capabilities and working with state-of-the-art open-weight models to achieve state of the art domain-specific performance by leveraging the agent-specific data captured by <a href="https://scale.com/genai-platform">Scale GenAI Platform (SGP)</a>. Our future research workstreams include scaling to more complex enterprise problems and multi-agent training.</p>
<p dir="ltr">The implications for enterprise customers are transformative: enabling performance for enterprise-specific agents that is simply not possible with other solutions. With Scale's Enterprise work in reinforcement learning, our customers are deploying agents that learn and adapt to their specific processes, delivering superior performance while dramatically reducing implementation time. Scale's Enterprise team is pushing the boundaries of reinforcement learning research to train superior enterprise agents.</p>
<p dir="ltr">To learn more about how Scale can help you implement reinforcement learning for agents to improve on your complex workflows, book a meeting below.</p>

Scale's Research in Enterprise Reinforcement Learning for Agents

Penn Jenks

Training the Next Generation of Enterprise Agents: Scale's Research in Reinforcement Learning