We ask how employers contribute to unemployment scarring in the recruitment process in the German-speaking part of Switzerland. By drawing on recruitment theories, we aim to better understand how recruiters assess different patterns of unemployment in a job candidate’s CV and how this affects the chances of young applicants being considered for a vacancy. We argue that in contexts with tight school-work linkage and highly standardised Vocational Education and Training systems, the detrimental effect of early unemployment depends on how well the applicant’s profile matches the requirements of the advertised position. To test this assumption, we surveyed Swiss recruiters who were seeking to fill positions during the time of data collection. We employed a factorial survey experiment that tested how the (un)employment trajectories in hypothetical young job applicants’ CV affected their chances of being considered for a real vacancy. Our results show that unemployment decreases the perceived suitability of an applicant for a specific job, which implies there is a scarring effect of unemployment that increases with the duration of being unemployed. But we also found that these effects are moderated by how well the applicant’s profile matches the job’s requirements. Overall, the worse the match between applicant’s profile and the job profile, the smaller are the scarring effects of unemployment. In sum, our findings contribute to the literature by revealing considerable heterogeneity in the scarring effects of unemployment. Our findings further suggest that the scarring effects of unemployment need to be studied with regard to country-specific institutional settings, the applicants’ previous education and employment experiences, and the job characteristics.