Improve General Quality

When properly set up, Evaluation Tasks are the primary way to monitor the overall quality of a project, and will also be a big indicator of how successful your Production batches will be.

Understanding why quality is poor

Inspect common answers
Look to see what are the trends in the task completions through the Common Answers feature.

Inspect common answers
Look to see what are the trends in the task completions through the Common Answers feature.

This specific selection will show results that are 0-50% accurate

This specific selection will show results that are 0-50% accurate

If taskers seem to make a lot of common mistakes...

Create more comprehensive training
Through looking at Common Answers you can identify which tasks have a lot of common mistakes. These tasks are good candidates to be used as Training Tasks.

For any task, you can easily Convert into a training task right at the Task view.

Clicking `Convert` allows you to convert to training task

Clicking Convert allows you to convert to training task

Add common mistakes to your Instructions
Common mistakes can also be included in your Instructions to provide examples of what not to do to the taskers.

In Definition you can access Advanced Options and automatically convert rejected audits into common errors in your Project Instructions.

`Common errors updates` adjust your Instructions to include rejected audits

Common errors updates adjust your Instructions to include rejected audits

If reported quality seems mismatched with your expectations...

Tune grading
Adjusting the ranking of responses will update the grading and create a quality grading system more in tune with your needs

Access `Tune Grading` through Quality Lab

Access Tune Grading through Quality Lab

Adjust a random sample of 5 tasks to be ranked from best to worst - this ranking will tune the grading if a valid grading configuration exists for that order

Adjust a random sample of 5 tasks to be ranked from best to worst - this ranking will tune the grading if a valid grading configuration exists for that order

Updated a month ago