Skip to main content

Automated VS Hand Picking

When setting up a Study, you can either automate the invite process or hand pick who you invite. So which is for you?

Participant selection controls who gets into your study: the system (Automated) or you (Hand picking). You'll find it on the Recruit tab under Settings, as Participant selection.

How automated works

The system invites applicants who score 100% automatically, either straight into your task or into available session slots. Scoring comes entirely from your multiple-choice screener answers set to Must select. A few things follow from that:

  • Open-text screener answers carry no weight. The system can't score them, so an open-text-only screener gives automated mode nothing to work with.

  • Below 100% isn't invited automatically. Anyone can apply, and lower-fit applicants score lower. You can still invite them yourself from the participant list.

  • Knockouts screen applicants out. Anyone who chooses a Knockout answer leaves the screener and isn't invited. Make your deal-breakers Knockout answers and your must-haves Must select answers.

  • Too many Must selects can slow recruitment. Each one makes 100% harder to reach, so fewer applicants are invited automatically.

See how screeners work before choosing automated.

When to choose automated

Speed and low effort. It suits early discovery calls, large-scale unmoderated studies and surveys, and any study where your screeners fully define a good participant and the demographic mix doesn't matter.

Your remaining job is to review submissions within 24 hours for unmoderated studies, or simply turn up to the sessions for moderated ones.

When to choose hand picking

Control. You review each applicant's eligibility score and screener answers and invite the people you want. Choose it when the mix matters (quotas across groups), when fit is nuanced, or when you want to read open-text answers before inviting.

Knocked-out applicants are hidden from your list by default. Use the filter on the participant table to show them if you want to review who was screened out.

It costs more of your time, but two features take most of the work out of it:

  • Quota targets on the Recruit tab let you define audience segments with custom quotas.

  • Segments let you filter and bulk-invite applicants once the study is live.

A simple split? Consider two automated studies

If your groups differ on a single criterion, such as gender or one screener answer, you can run two automated studies, one per group. For anything more nuanced, use hand picking with quota targets or segments.

Did this answer your question?