The Quality tab allows you to audit a random sample of tasks for quality and view stats for tasks you’ve audited
Why should you audit tasks?
Auditing tasks allow you to provide feedback directly to our taskers. This will help us identify common errors or clarify edge cases
There are two ways to audit tasks:
How to audit completed tasks individually:
How to audit all completed tasks within a date range:
Audit all tasks completed across a week:
If you have multiple people on your team auditing at the same time, we will “lock” each task so that only one person can audit one task at a time. This was designed to prevent conflicted copies.
Within the audit workflow, you are able to make the following selections:
Reject vs. Make Changes
- Both Reject and Make Changes will provide feedback to the Scale team about the quality of your tasks.
- For quick or minor changes, please Make Changes as you will get an updated callback response right away. In addition, not all rejected tasks will be resubmitted. Please contact your engagement manager if you want to discuss re-dos
- For critical and more structural misunderstanding of the instructions, please Reject the task and provide detailed feedback! This will help our taskers to improve.
When an audit is submitted, several new field will be added to the callback body:
customer_review_status: Reflects the result of the audit as “Accepted”, “Rejected” or “Fixed”
customer_review_comments: Shows all comment left during the audit
prior_responses: Response before the audit
If a task is fixed through multiple audits:
response: will be updated with the most recent audit
customer_review_status: will reflect the most recent audit
customer_review_comments: will append the comment to the array
prior_responses: will append previous responses to the array