Advanced Settings

Each use case comes with a different set of project settings.

Pipeline Setting Name Description
Shared by all pipelines Auto redo rejected tasks Automatically redo rejected audits with a 50% surcharge for the redos
Language requirement Specify the language requirement for labelers in your project (default: English)
Language fluency Specify if you need a higher degree of language fluency (default: Basic)
Inherit labelers Inherit labelers from another projects
Edge case alert Allow labelers to surface edge cases
Common errors updates Automatically convert rejected audits into common errors in instruction
Common confusions Warn labelers when picking commonly confused category options based on your audits
Percentile for promotion (%) Specifies the percentile for promotion to reviewer
Percentile for initial stage demotion (%) Specifies the percentile for initial stage labelers to be screened off the project
Percentile for review stage demotion (%) Specifies the percentile for review stage labelers to be demoted to initial stage labelers on the project
Standard pipeline Additional layers of reviews Specify the additional number of reviews needed
Consensus pipeline Additional layers of reviews Specify the additional number of reviews needed
Additional attempts for consensus Specify the number of initial labeler responses to collect. A consensus result will be calculated based on these responses.
Reviews confidence threshold percentile (%) Specify the confidence threshold for the review stage. If the task's confidence is lower than the threshold, then the task will get an additional layer of review.
Generation pipeline Additional responses to collect Specify the number of final responses to be returned per task
Updated 8 months ago