TY - JOUR
T1 - Dependent interviewing
T2 - A remedy or a curse for measurement error in surveys?
AU - Pankowska, Paulina
AU - Bakker, Bart
AU - Oberski, Daniel
AU - Pavlopoulos, Dimitris
N1 - Publisher Copyright:
© 2021, European Survey Research Association. All rights reserved.
PY - 2021
Y1 - 2021
N2 - Longitudinal surveys often rely on dependent interviewing (DI) to lower the levels of random measurement error in survey data and reduce the incidence of spurious change. DI refers to a data collection technique that incorporates information from prior interview rounds into subsequent waves. While this method is considered an effective remedy for random measurement error, it can also introduce more systematic errors, in particular when respondents are first re-minded of their previously provided answer and then asked about their current status. The aim of this paper is to assess the impact of DI on measurement error in employment mobility. We take advantage of a unique experimental situation that was created by the roll-out of dependent interviewing in the Dutch Labour Force Survey (LFS). We apply hidden Markov modelling (HMM) to linked LFS and Employment Register (ER) data that cover a period before and after dependent interviewing was abolished, which in turn enables the modelling of systematic errors in the LFS data. Our results indicate that DI lowered the probability of obtaining random measurement error but had no significant effect on the systematic component of the error. The lack of a significant effect, particularly in the case of autocorrelated errors, might be driven by the fact that the probability of repeating the same error was extremely high at baseline (i.e. when using standard, independent interviewing); therefore the use of DI could not increase this probability any further.
AB - Longitudinal surveys often rely on dependent interviewing (DI) to lower the levels of random measurement error in survey data and reduce the incidence of spurious change. DI refers to a data collection technique that incorporates information from prior interview rounds into subsequent waves. While this method is considered an effective remedy for random measurement error, it can also introduce more systematic errors, in particular when respondents are first re-minded of their previously provided answer and then asked about their current status. The aim of this paper is to assess the impact of DI on measurement error in employment mobility. We take advantage of a unique experimental situation that was created by the roll-out of dependent interviewing in the Dutch Labour Force Survey (LFS). We apply hidden Markov modelling (HMM) to linked LFS and Employment Register (ER) data that cover a period before and after dependent interviewing was abolished, which in turn enables the modelling of systematic errors in the LFS data. Our results indicate that DI lowered the probability of obtaining random measurement error but had no significant effect on the systematic component of the error. The lack of a significant effect, particularly in the case of autocorrelated errors, might be driven by the fact that the probability of repeating the same error was extremely high at baseline (i.e. when using standard, independent interviewing); therefore the use of DI could not increase this probability any further.
KW - Dependent interviewing (DI)
KW - Hidden Markov models (HMM)
KW - Measurement error
KW - Panel survey
UR - http://www.scopus.com/inward/record.url?scp=85113944239&partnerID=8YFLogxK
U2 - 10.18148/srm/2021.v15i2.7640
DO - 10.18148/srm/2021.v15i2.7640
M3 - Article
AN - SCOPUS:85113944239
VL - 15
SP - 135
EP - 146
JO - Survey Research Methods
JF - Survey Research Methods
IS - 2
ER -