You can manage how the contributions to be assessed are distributed to assessors in the Assign assessors step when configuring your challenge.

Automatic allocations

By default, the assignment of evaluations for the tasks submitted by participants is automatic, ensuring that each task receives a roughly equal number of evaluations. You simply need to define the number of tasks or participants to evaluate.

<aside> 💡

The assignment is done automatically and randomly when the participant logs in. Contributions with the fewest evaluations are prioritized in the assignment process.

</aside>

Manual allocations

If you wish to define the groups or participants who should evaluate each other, you can do so by selecting the evaluator and the participants or groups to be evaluated. You can also find this configuration in the work submission phase, where you can select the task to be evaluated and the participants who should perform the evaluation.

<aside> 💡

Automatic assignment can indeed be combined with manual assignment. For example, this allows you to assign a larger number of tasks to evaluate to a specific participant.

</aside>

image.png