Getting data to train and evaluate your large language models has never been more Rapid! Introducing…Scale’s Large Language Model Toolkit! 

Introduction

OpenAI just released their new model that powers ChatGPT, GPT-3.5 Turbo. The best part — it's 10x cheaper than their previous best model.

Have you ever listened to the song, “Umi Says” by Mos Def? It’s a fantastic song and in the chorus, Mos Def sings, “My Umi said, shine your light on the world. Shine your light for the world to see.” My mother would say the same thing to me when I was younger and she still says it to this day! But what once started as rhythmic words of encouragement, now has begun to transform into a deeper, more raw sense of self. It has taught me that we can brandish one’s individuality by sharing experiences, growing from adversities, and passing lessons learned onto my peers, and, to me, that is what I believe Black History Month is truly about. I never saw it as a design to cast blame or seek apologies; but rather a time to appreciate both Black culture and Black contributions. It is a time to develop a profound understanding of our current generation and those that came before us. Because from listening, comes understanding.  

Scale hosted its first ever generative AI hackathon at our San Francisco headquarters on January 21st! We welcomed over 300 developers, engineers, and hackers from across the country to come in and create something awesome. 

Instead of simply predicting the next word(s), Large Language Models (LLMs) can now follow human instructions and provide useful responses. These advancements are made possible by fine-tuning them with specialized instruction datasets and a technique called Reinforcement Learning with Human Feedback (RLHF). 

In order to facilitate the automation and speed of maintaining surface to air missiles (SAM) systems chain of custody, Scale developed an AI powered system to track movements at these sites using EO satellite imagery. This blog post explores some of the implementation and novel concepts around the problem.

Scale AI is dedicated to helping the Department of Defense (DoD) compete, fight, and win by providing high-quality, government-owned data that can power any AI/ML and autonomy effort. A first step towards this goal is organizing the DoD data layer. Technologies still relatively new for the DoD - like cloud computing and data repositories - are a good start. These are insufficient however, to provide the DoD with data processing capabilities required to fuel large-scale autonomy operations. Scale can provide the next critical layer in the software stack which can bring autonomy efforts out of the labs, into production, and onto the battlefield.