Blog
Company Updates & Technology Articles
September 5, 2023
How to Fine-Tune GPT-3.5 Turbo With OpenAI API
OpenAI recently announced the release of their GPT-3.5 Turbo fine-tuning APIs. At Scale we have always believed that building custom LLMs through fine-tuning is the key to unlocking greater performance for any given organization’s specific use case. OpenAI also named Scale as their preferred enterprise fine-tuning partner for GPT-3.5, and we have already shown early progress for the power of fine-tuning GPT-3.5 for customers like Brex. While the pre-trained GPT-3.5 model can often solve tasks with prompt engineering, the model becomes even more powerful when fine-tuned, in some cases surpassing GPT-4 in performance. Let’s walk you through how to fine-tune GPT-3.5 in this blog post.
August 29, 2023
How To Reduce Cold Start Times For LLM Inference
At Scale, we host a diverse set of deep learning models for both internal and external users. The recent boom of large language models (LLMs) brought a set of new technical challenges and pod cold start is one of the most important. By reducing cold start time, we were able to reduce cost while maintaining a stable latency SLA. We’d like to share our learnings on why cold start is an important problem and how we reduced the cold start time of LLMs with LLM Engine.
August 24, 2023
OpenAI Names Scale as Preferred Partner to Fine-Tune GPT-3.5
Today, we are excited to announce a strategic partnership with OpenAI, providing GPT-3.5 fine-tuning for the world’s leading enterprises. At Scale, we believe that fine-tuning is the key to unlocking the performance of LLMs for any organization's most critical use cases - and we have seen both great excitement and demand for this fine-tuning capability from the market. Our partnership brings together OpenAI's advanced base model GPT-3.5 with Scale's fine-tuning expertise and industry-leading Data Engine to help every company create custom state-of-the-art models for their specific business needs. Scale already performs fine-tuning for many commercial and open-source models. As OpenAI’s preferred fine-tuning partner for GPT-3.5, we are excited to leverage their powerful APIs to help even more enterprises build the most powerful custom LLMs that increase efficiency while reducing costs.
