Skip to content
Research Article Open access CC BY 3.0

Validity of Workers’ Self-Reports. Evaluation of a Question Assessing Lifetime Exposure to Occupational Physical Activity

Anne Møller, Susanne Reventlow, Johan Hviid Andersen, Kirsten Avlund, Ole Steen Mortensen

Journal of Advances in Medicine and Medical Research · pp. 536–552 · Published 21 Sep 2012

10.9734/BJMMR/2012/1607

Abstract

Aims: In epidemiological studies exposure assessment based on questionnaires is the most cost-effective method. A question about lifetime exposure to occupational physical activity (OPA) was used in a population-based survey (part of the Copenhagen Aging and Midlife Biobank, CAMB). The aim of the study was to validate this question through a three-step process. Methodology: Firstly, the response process was studied by cognitive interviewing of 7 persons. Secondly, 64 persons participated in semi-structured interviews about their work-life, and expert judgments of exposure to OPA were compared with questionnaire-data. Exposure was 20 years of work in one of four categories of OPA: sedentary, standing and walking, moderate or high OPA. Kappa values were calculated for agreement and interpreted according to Landis and Koch’s criteria. Agreement was visualized in Bland-Altman plots. Thirdly, intra- and inter-rater reliability of expert judgments was tested. Results: Response process: The question had a complicated instruction, and the respondents found it hard to remember, categorize, and summate exposures. Semi-structured interviews: Kappa value for exposure to sedentary work was ‘substantial’ (0.71) but ‘fair’ for the other categories of OPA (0.27-0.29). Agreement between questionnaire and interview was higher in sedentary jobs and jobs with high OPA. Intra-rater reliability of expert judgments was ‘substantial’ or ‘moderate’ (0.60-0.71). Inter-rater reliability was high in sedentary jobs but lower in the more active jobs. Conclusion: Self-reports of lifetime exposure to sedentary work are valid in the CAMB cohort, whereas the validity of self-reports of exposure to high levels of occupational physical activity (OPA) are questionable. Thorough pre-testing of questions about lifetime OPA is recommended.

Validity self-reports occupational physical activity inter-rater reliability intra-rater reliability cognitive interviewing Bland-Altman plots qualitative methods.

References (27)

  1. 1 Practical Statistics for Medical Research [DOI]
  2. 2 Health Measurement Scales: A Practical Guide to Their Development and Use
  3. 3 Measuring agreement in method comparison studies [DOI]
  4. 4 The Psychology of Survey Response [DOI]
  5. 5 Cognitive Interviewing: A Tool for Improving Questionnaire Design
  6. 6 Pretesting survey instruments: An overview of cognitive methods [DOI]
  7. 7 Doing Qualitative Research [DOI]
  8. 8 Doing Qualitative Research [DOI]
  9. 9 Reproducibility and validity of workers’ self-reports of physical work demands [DOI]
  10. 10 Using Cognitive Interviews to Develop Surveys in Diverse Populations [DOI]
  11. 11 Principles of exposure measurement in epidemiology : collecting, evaluating, and improving measures of disease risk factors
  12. 12 Construct validity of a revised Physical Activity Scale and testing by cognitive interviewing [DOI]
  13. 13 The repeatability and validity of questionnaires assessing occupational physical activity – a systematic review [DOI]
  14. 14 Validity of self-reported exposures to work postures and manual materials handling. Stockholm MUSIC I Study Group. [DOI]
  15. 15 Validity of self-reported physical work load in epidemiologic studies on musculoskeletal disorders [DOI]
  16. 16 Trends in the Danish work environment in 1990-2000 and their associations with labor-force changes [DOI]
  17. 17 Retrospective assessment of occupational exposure to chemicals in community-based studies: validity and repeatability of industrial hygiene panel ratings [DOI]
  18. 18 Social disparities in the burden of occupational exposures: Results of a cross‐sectional study [DOI]
  19. 19 Improving a newly developed patient-reported outcome for thyroid patients, using cognitive interviewing [DOI]
  20. 20 Reliability of job-title based physical work exposures for the upper extremity: comparison to self-reported and observed exposure estimates [DOI]
  21. 21 Evaluation of questionnaire-based information on previous physical work loads [DOI]
  22. 22 Validity of self-reported duration of work postures obtained by interview [DOI]
  23. 23 Translation And Cultural Adaptation Of A Mental Health Outcome Measure: The Basis-R© [DOI]
  24. 24 The influence of sociodemographic characteristics on agreement between self‐reports and expert exposure assessments [DOI]
  25. 25 Physical diability after retirement and occupational risk factors during working life: a cross sectional epidemiological study in the Paris area. [DOI]
  26. 26 Expert consensus ratings of job categories from the Third National Health and Nutrition Examination Survey (NHANES III) [DOI]
  27. 27 Lifetime Occupational Physical Activity and Musculoskeletal Aging in Middle-Aged Men and Women in Denmark: Retrospective Cohort Study Protocol and Methods [DOI]

Cited by 13

Communicating epidemiological results through alternative indicators: Cognitive interviewing to assess a questionnaire on risk perception in a high environmental risk area

Domenica Farinella, Gianna Terni, Annibale Biggeri · Cogent Social Sciences · 2017

Does physical exposure throughout working life influence chair-rise performance in midlife? A retrospective cohort study of associations between work and physical function in Denmark

Anne Møller, Susanne Reventlow, Åse Marie Hansen · BMJ Open · 2015

Physical activity paradox: could inflammation be a key factor?

Joshua Buron Feinberg, Anne Møller, Volkert Siersma · British Journal of Sports Medicine · 2022

Influence of physical and psychosocial work environment throughout life and physical and cognitive capacity in midlife on labor market attachment among older workers: study protocol for a prospective cohort study

Emil Sundstrup, Åse Marie Hansen, Erik Lykke Mortensen · BMC Public Health · 2016

Retrospectively assessed psychosocial working conditions as predictors of prospectively assessed sickness absence and disability pension among older workers

Emil Sundstrup, Åse Marie Hansen, Erik Lykke Mortensen · BMC Public Health · 2018

Retrospectively assessed physical work environment during working life and risk of sickness absence and labour market exit among older workers

Emil Sundstrup, Åse Marie Hansen, Erik Lykke Mortensen · Occupational and Environmental Medicine · 2017

Cumulative occupational mechanical exposures during working life and risk of sickness absence and disability pension: prospective cohort study

Emil Sundstrup, Ã…se Marie Hansen, Erik Lykke Mortensen · Scandinavian Journal of Work, Environment & Health · 2017

Showing 7 of 13 known citations — external sources report more than can currently be individually listed.

Related research

Article metrics

Real usage data collected on this platform.

21

Page views

0

PDF downloads

3

Outbound clicks

13

Citations

Views over time

Views by country

Approximate, from request IP at view time — not citizenship or institution. Countries with fewer than 5 views are grouped as "Other".

Traffic sources

Referring site, by host.

Views and downloads exclude known bots/crawlers. Citations combines this platform's own DOI-resolved index with each external source's own reported total — see Cited by above for individually listed citing works. Last refreshed 0 seconds ago.