Introduction: This paper reports a study done to estimate the reliability and validity of answers to the Youth and Adult questionnaires of the Population Assessment of Tobacco and Health (PATH) Study.
Methods: 407 adults and 117 youth respondents completed the wave 4 (2016-2017) PATH Study interview twice, 6-24 days apart. The reinterview data were used to estimate the reliability of answers to the questionnaire. Kappa statistics, gross discrepancy rates and correlations between answers to the initial interview and the reinterview were used to measure reliability. We examined every item in the questionnaire for which there were at least 100 observations. After the reinterview, most respondents provided a saliva sample that allowed us to assess the accuracy of their answers to the tobacco use questions.
Results: There was generally a very high level of agreement between answers in the interview and reinterview. On the key current tobacco use items, the average kappa (the agreement rate adjusted for chance agreement) was 0.79 for adult respondents (age 18 or older). Youth respondents exhibited equally high levels of agreement across interviews. The items on current tobacco use also exhibited high levels of agreement with saliva test results (kappa=0.72). Rating scale items showed lower levels of exact agreement across interviews but the answers were generally within one scale point or category.
Conclusions: The PATH Study questions were developed using a careful protocol and the results indicate the answers provide reliable and valid information about tobacco use.
Keywords: cotinine; nicotine; non-cigarette tobacco products.
© Author(s) (or their employer(s)) 2019. No commercial re-use. See rights and permissions. Published by BMJ.
Conflict of interest statement
Competing interests: None declared.
Validity and reliability in reporting sexual partners and condom use in a Swiss population survey.Eur J Epidemiol. 1998 Feb;14(2):139-46. doi: 10.1023/a:1007435824281. Eur J Epidemiol. 1998. PMID: 9556172
Health-related quality of life in early breast cancer.Dan Med Bull. 2010 Sep;57(9):B4184. Dan Med Bull. 2010. PMID: 20816024
Indicators of dependence for different types of tobacco product users: Descriptive findings from Wave 1 (2013-2014) of the Population Assessment of Tobacco and Health (PATH) study.Drug Alcohol Depend. 2017 Sep 1;178:257-266. doi: 10.1016/j.drugalcdep.2017.05.010. Epub 2017 Jun 28. Drug Alcohol Depend. 2017. PMID: 28675817
[Diagnostic structured interviews in child and adolescent's psychiatry].Encephale. 2004 Mar-Apr;30(2):122-34. doi: 10.1016/s0013-7006(04)95422-x. Encephale. 2004. PMID: 15107714 Review. French.
Reliability of Key Measures in the National Survey on Drug Use and Health [Internet].Rockville (MD): Substance Abuse and Mental Health Services Administration (US); 2010 Feb. Substance Abuse and Mental Health Services Administration (US). 2010. PMID: 30199182 Free Books & Documents. Review.
Cited by 7 articles
Diminished Returns of Educational Attainment on Heart Disease among Black Americans.Open Cardiovasc Med J. 2020;14:5-12. doi: 10.2174/1874192402014010005. Epub 2020 Apr 16. Open Cardiovasc Med J. 2020. PMID: 32399080 Free PMC article.
Race, Ethnicity, Socioeconomic Status, and Chronic Lung Disease in the U.S.Res Health Sci. 2020;5(1):48-63. doi: 10.22158/rhs.v5n1p48. Epub 2020 Feb 10. Res Health Sci. 2020. PMID: 32226910 Free PMC article.
Educational Attainment and Tobacco Harm Knowledge Among American Adults: Diminished Returns of African Americans and Hispanics.Int J Epidemiol Res. 2020 Winter;7(1):http://ijer.skums.ac.ir/article_37230_1b660b357edc924c767ce72f1430ab14.pdf. Int J Epidemiol Res. 2020. PMID: 32219175 Free PMC article.
Association of Educational Attainment and Race/Ethnicity With Exposure to Tobacco Advertisement Among US Young Adults.JAMA Netw Open. 2020 Jan 3;3(1):e1919393. doi: 10.1001/jamanetworkopen.2019.19393. JAMA Netw Open. 2020. PMID: 31951271 Free PMC article.
Association Between Parental Educational Attainment and Youth Outcomes and Role of Race/Ethnicity.JAMA Netw Open. 2019 Nov 1;2(11):e1916018. doi: 10.1001/jamanetworkopen.2019.16018. JAMA Netw Open. 2019. PMID: 31755951 Free PMC article.