The Role of Interviewer Observations in Obtaining Representative Data in Repeated Cross-National Studies
Collecting representative data from surveys can be challenging in a survey climate where response rates are declining and costs are rising, but such data are essential for making valid inferences in social research. These issues can be compounded when conducting cross-national surveys that are repe...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
European Survey Research Association
2024-08-01
|
| Series: | Survey Research Methods |
| Subjects: | |
| Online Access: | https://ojs.ub.uni-konstanz.de/srm/article/view/8145 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1823861400900993024 |
|---|---|
| author | Hafsteinn Einarsson Alexandru Cernat Natalie Shlomo |
| author_facet | Hafsteinn Einarsson Alexandru Cernat Natalie Shlomo |
| author_sort | Hafsteinn Einarsson |
| collection | DOAJ |
| description |
Collecting representative data from surveys can be challenging in a survey climate where response rates are declining and costs are rising, but such data are essential for making valid inferences in social research. These issues can be compounded when conducting cross-national surveys that are repeated over time. This paper utilises the European Social Survey (ESS) contact form data to explore cross-national associations with nonresponse over time. Using sample frame data and interviewer observations, a form of paradata where interviewers record characteristics of the household and its neighbourhood, we construct representativity indicators (R-indicators) for each country over nine survey rounds and identify variables that contribute to non-representativeness. We find that interviewer observations produce evidence of non-representativeness, even after controlling for frame information, consistently and without large cross-national variations. In addition, they are stable over time, despite the trend of declining response rates. Consistent associations with the propensity to respond can be leveraged in several ways in survey practice, and we discuss how interviewer observations may be utilised in tasks such as fieldwork monitoring, to inform case prioritisation schemes where units associated with underrepresented characteristics are targeted (including in adaptive and responsive survey designs), and in post-survey adjustment in repeated cross-national surveys. These methods may reduce the risk of differential survey errors occurring in such surveys.
|
| format | Article |
| id | doaj-art-37ea3d47ed7a40e68c3f34c179c12e3d |
| institution | Kabale University |
| issn | 1864-3361 |
| language | English |
| publishDate | 2024-08-01 |
| publisher | European Survey Research Association |
| record_format | Article |
| series | Survey Research Methods |
| spelling | doaj-art-37ea3d47ed7a40e68c3f34c179c12e3d2025-02-09T14:16:10ZengEuropean Survey Research AssociationSurvey Research Methods1864-33612024-08-01182The Role of Interviewer Observations in Obtaining Representative Data in Repeated Cross-National StudiesHafsteinn Einarsson0Alexandru Cernat1https://orcid.org/0000-0003-2176-1215Natalie Shlomo2https://orcid.org/0000-0003-0701-5080University of ManchesterUniversity of ManchesterUniversity of Manchester Collecting representative data from surveys can be challenging in a survey climate where response rates are declining and costs are rising, but such data are essential for making valid inferences in social research. These issues can be compounded when conducting cross-national surveys that are repeated over time. This paper utilises the European Social Survey (ESS) contact form data to explore cross-national associations with nonresponse over time. Using sample frame data and interviewer observations, a form of paradata where interviewers record characteristics of the household and its neighbourhood, we construct representativity indicators (R-indicators) for each country over nine survey rounds and identify variables that contribute to non-representativeness. We find that interviewer observations produce evidence of non-representativeness, even after controlling for frame information, consistently and without large cross-national variations. In addition, they are stable over time, despite the trend of declining response rates. Consistent associations with the propensity to respond can be leveraged in several ways in survey practice, and we discuss how interviewer observations may be utilised in tasks such as fieldwork monitoring, to inform case prioritisation schemes where units associated with underrepresented characteristics are targeted (including in adaptive and responsive survey designs), and in post-survey adjustment in repeated cross-national surveys. These methods may reduce the risk of differential survey errors occurring in such surveys. https://ojs.ub.uni-konstanz.de/srm/article/view/8145nonresponseparadataR-indicator3MC surveysEuropean Social Surveycross-country comparisons |
| spellingShingle | Hafsteinn Einarsson Alexandru Cernat Natalie Shlomo The Role of Interviewer Observations in Obtaining Representative Data in Repeated Cross-National Studies Survey Research Methods nonresponse paradata R-indicator 3MC surveys European Social Survey cross-country comparisons |
| title | The Role of Interviewer Observations in Obtaining Representative Data in Repeated Cross-National Studies |
| title_full | The Role of Interviewer Observations in Obtaining Representative Data in Repeated Cross-National Studies |
| title_fullStr | The Role of Interviewer Observations in Obtaining Representative Data in Repeated Cross-National Studies |
| title_full_unstemmed | The Role of Interviewer Observations in Obtaining Representative Data in Repeated Cross-National Studies |
| title_short | The Role of Interviewer Observations in Obtaining Representative Data in Repeated Cross-National Studies |
| title_sort | role of interviewer observations in obtaining representative data in repeated cross national studies |
| topic | nonresponse paradata R-indicator 3MC surveys European Social Survey cross-country comparisons |
| url | https://ojs.ub.uni-konstanz.de/srm/article/view/8145 |
| work_keys_str_mv | AT hafsteinneinarsson theroleofinterviewerobservationsinobtainingrepresentativedatainrepeatedcrossnationalstudies AT alexandrucernat theroleofinterviewerobservationsinobtainingrepresentativedatainrepeatedcrossnationalstudies AT natalieshlomo theroleofinterviewerobservationsinobtainingrepresentativedatainrepeatedcrossnationalstudies AT hafsteinneinarsson roleofinterviewerobservationsinobtainingrepresentativedatainrepeatedcrossnationalstudies AT alexandrucernat roleofinterviewerobservationsinobtainingrepresentativedatainrepeatedcrossnationalstudies AT natalieshlomo roleofinterviewerobservationsinobtainingrepresentativedatainrepeatedcrossnationalstudies |