Evaluating the Effect of Monetary Incentives on Web Survey Response Rates in the UK Millennium Cohort Study

A major objective for longitudinal studies is retaining participants over time. The Millennium Cohort Study (MCS) is the largest on-going nationally representative study of young people in the UK (N = 18,818). Seven waves of data collection took place face-to-face between 2001 (age 9 months) and 20...

Full description

Saved in:
Bibliographic Details
Main Authors: Charlotte Booth, Erica Wong, Matt Brown, Emla Fitzsimons
Format: Article
Language:English
Published: European Survey Research Association 2024-04-01
Series:Survey Research Methods
Subjects:
Online Access:https://ojs.ub.uni-konstanz.de/srm/article/view/8210
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1823861419174526976
author Charlotte Booth
Erica Wong
Matt Brown
Emla Fitzsimons
author_facet Charlotte Booth
Erica Wong
Matt Brown
Emla Fitzsimons
author_sort Charlotte Booth
collection DOAJ
description A major objective for longitudinal studies is retaining participants over time. The Millennium Cohort Study (MCS) is the largest on-going nationally representative study of young people in the UK (N = 18,818). Seven waves of data collection took place face-to-face between 2001 (age 9 months) and 2019 (age 17), with no monetary incentives offered. Throughout 2020 to 2021, participants were invited to take part in three web surveys focused on understanding the impact of the COVID-19 pandemic. In the third web survey, conditional monetary incentives were introduced in the form of a randomised experiment. Three quarters of the issued sample were offered a £10 voucher to complete the survey and the remaining proportion were offered no incentive as usual. Regression analyses were conducted to examine the effect of the incentive on response rates and various aspects of data quality. The incentive boosted the response rate by 7 percentage points, from a baseline of 24%, with a stronger effect observed in those who had taken part in the most recent major wave. Regarding data quality, the incentivised group showed lower break-off rates and spent more time completing the survey. Therefore, the incentive had a significant positive effect on response rates and some aspects of data quality. Future research should evaluate the effect of incentives in relation to other modes of data collection and consider alternative strategies to improve response rates for previous non-respondents, who are considered harder to reach.
format Article
id doaj-art-949f0528aba747bc9581133d89bd8f39
institution Kabale University
issn 1864-3361
language English
publishDate 2024-04-01
publisher European Survey Research Association
record_format Article
series Survey Research Methods
spelling doaj-art-949f0528aba747bc9581133d89bd8f392025-02-09T14:16:11ZengEuropean Survey Research AssociationSurvey Research Methods1864-33612024-04-01181Evaluating the Effect of Monetary Incentives on Web Survey Response Rates in the UK Millennium Cohort StudyCharlotte Booth0Erica WongMatt BrownEmla FitzsimonsUniversity College London A major objective for longitudinal studies is retaining participants over time. The Millennium Cohort Study (MCS) is the largest on-going nationally representative study of young people in the UK (N = 18,818). Seven waves of data collection took place face-to-face between 2001 (age 9 months) and 2019 (age 17), with no monetary incentives offered. Throughout 2020 to 2021, participants were invited to take part in three web surveys focused on understanding the impact of the COVID-19 pandemic. In the third web survey, conditional monetary incentives were introduced in the form of a randomised experiment. Three quarters of the issued sample were offered a £10 voucher to complete the survey and the remaining proportion were offered no incentive as usual. Regression analyses were conducted to examine the effect of the incentive on response rates and various aspects of data quality. The incentive boosted the response rate by 7 percentage points, from a baseline of 24%, with a stronger effect observed in those who had taken part in the most recent major wave. Regarding data quality, the incentivised group showed lower break-off rates and spent more time completing the survey. Therefore, the incentive had a significant positive effect on response rates and some aspects of data quality. Future research should evaluate the effect of incentives in relation to other modes of data collection and consider alternative strategies to improve response rates for previous non-respondents, who are considered harder to reach. https://ojs.ub.uni-konstanz.de/srm/article/view/8210incentive experimentlongitudinal surveydata qualityresponse rates
spellingShingle Charlotte Booth
Erica Wong
Matt Brown
Emla Fitzsimons
Evaluating the Effect of Monetary Incentives on Web Survey Response Rates in the UK Millennium Cohort Study
Survey Research Methods
incentive experiment
longitudinal survey
data quality
response rates
title Evaluating the Effect of Monetary Incentives on Web Survey Response Rates in the UK Millennium Cohort Study
title_full Evaluating the Effect of Monetary Incentives on Web Survey Response Rates in the UK Millennium Cohort Study
title_fullStr Evaluating the Effect of Monetary Incentives on Web Survey Response Rates in the UK Millennium Cohort Study
title_full_unstemmed Evaluating the Effect of Monetary Incentives on Web Survey Response Rates in the UK Millennium Cohort Study
title_short Evaluating the Effect of Monetary Incentives on Web Survey Response Rates in the UK Millennium Cohort Study
title_sort evaluating the effect of monetary incentives on web survey response rates in the uk millennium cohort study
topic incentive experiment
longitudinal survey
data quality
response rates
url https://ojs.ub.uni-konstanz.de/srm/article/view/8210
work_keys_str_mv AT charlottebooth evaluatingtheeffectofmonetaryincentivesonwebsurveyresponseratesintheukmillenniumcohortstudy
AT ericawong evaluatingtheeffectofmonetaryincentivesonwebsurveyresponseratesintheukmillenniumcohortstudy
AT mattbrown evaluatingtheeffectofmonetaryincentivesonwebsurveyresponseratesintheukmillenniumcohortstudy
AT emlafitzsimons evaluatingtheeffectofmonetaryincentivesonwebsurveyresponseratesintheukmillenniumcohortstudy