Before working with Scale Rapid, Goodcall had mountains of real-world production data that was left unannotated. Because they were performing data annotation in-house, they couldn’t match the scale of available data. Every piece of unlabeled data was one less example that Goodcall could use to improve their models.

By training their models on a larger, more diverse dataset, Goodcall could unlock opportunities for improving model performance. With additional data, they could represent a wider range of customer experiences and identify and address edge cases that frequently led to model failures. For example, Goodcall could recognize utterances that their models performed poorly on, and make adjustments to compensate, improving overall accuracy. To provide the best possible results for every customer call, Goodcall needed a scalable, sustainable approach for labeling large quantities of data.

Scale Rapid provides simple, user-friendly tools that make it easy for companies like Goodcall to acquire the high-quality annotations they need. Goodcall can easily send a large collection of samples to Scale Rapid to be reviewed. In return, they receive text classification labels that describe the meaning of certain phrases. For example, if a text sample were to say, “I want to know when this business closes,” Goodcall would receive a label back from Scale indicating that this phrase is requesting business hours.

Goodcall extracts even more value from the annotations they get from Scale Rapid by checking these human-reviewed labels against the unlabeled items in their system. This way, they can have a wider variety of data that they can use to improve their models. With these annotations, Goodcall can improve the accuracy of a model’s text-to-speech transcripts, as well as enhance a bot’s ability to correctly understand intent.

Since Goodcall started working with Scale Rapid, they’ve improved their model’s intent classification by 5%. By outsourcing the labeling process, they’ve also freed up engineering time to tackle other problems. There have been additional unexpected benefits, too – Using Scale Rapid’s text classifications, Goodcall has identified opportunities for improvement in their speech recognition system, by uncovering limitations in their transcript and intent classification models. 

These text labels provide Goodcall with valuable insight into their chatbots, allowing them to quantify their models, identify issues, and assess why their models perform the way they do. Armed with this information, they’re able to make intelligent decisions to improve their product and, by extension, the customer experience.