Designing Health Literacy Measurement Tools: A Critical Review of Common Paths and Probable Mistakes

Document Type : Review Article.

Authors

1 Assistant Professor in Health Education & Health Promotion, School of Public Health and Safety, Shahid Beheshti University of Medical Sciences, Tehran, Iran.

2 Assistant Professor of Health Education and Promotion Department of Health Promotion and Education, School of Health, Alborz University of Medical Sciences, Alborz, Iran.

3 PhD Student in Health Education & Health Promotion, School of Public Health and Safety, Shahid Beheshti University of Medical Sciences, Tehran, Iran.

4 * Professor in Health Education & Health Promotion, School of Public Health and Safety, Shahid Beheshti University of Medical Sciences, Tehran, Iran.

Abstract

Background and Objective: Measuring concepts such as health literacy, either generally or specifically, in different populations requires the use of existing standard instruments or the development of new ones by the researcher. The study was conducted to critical review of common methodologies for instrument development in the health literacy. 

Materials and Methods:  This review article examines health literacy measurement tools with two objectives: 1) methodological review of tool design 2) review of the items used in each tool by posing this question (validity review) "Do the items measure what is intended in relation to the concept of health literacy and its dimensions?”. In order to access the health literacy tools, first was referred to the site "Health Literacy Tool Shed".10% of the available tools (20 item) were randomly included in the study for a deep and detailed review. 

Results: Finding showed, researchers employed three different approaches to the development of measurement instruments; 1) Review of literature or used the already existing instruments, 2) The qualitative approach to explain a concept and embrace it from different dimensions as well as construct the items and 3) Mix-method approach (a mixture the previous two approaches). Two mistakes include 1) interpretation error (error of qualitative content analysis, creation of categories and sub-categories from codes and meaning units) and 2) program error (error of exploiting subcategories and categories in designing and generating items and different parts of tools) reported. 

Conclusions: Paying attention and considering what was indicated regarding different approaches and paths as well as processes and methods can preserve researches to a large extent from the main problem that is the collection of inaccurate data due to instruments with low validity and reliability.

Keywords

Availability of data and materials: The data sets used and/or analyzed during the current study was available from the corresponding author on reasonable request.

Conflicts of Interests: No potential conflict of interest was reported by the author.

Consent for Publication: Not applicable

Ethics approval and consent to participate: "Not Applicable"

Funding: No financial support was received for this study.

Authors’ contributions: MGH designed the study. MGH, SR, AS, and FB designed the study wrote the first draft. All authors contributed to writing, revising, and approved the final manuscript.

References

1. Sorensen K, Van den Broucke S, Fullam J, Doyle G, Pelikan J, Slonska Z, et al. Consortium health literacy project european. health literacy and public health: a systematic review and integration of definitions and models. BMC public health. 2012;12:80.
https://doi.org/10.1186/1471-2458-12-80
PMid:22276600 PMCid:PMC3292515
 
2. Institute of Medicine (US) Committee on Health Literacy; Nielsen-Bohlman L PA, Kindig DA, . Health literacy: a prescription to end confusion.: Washington (DC): National Academies Press (US); 2004.  
 
3. Nutbeam D. Health literacy as a public health goal: a challenge for contemporary health education and communication strategies into the 21st century. Health Promotion International. 2000;15(3):259-67.
https://doi.org/10.1093/heapro/15.3.259
https://doi.org/10.1093/heapro/15.3.183  
 
4. Jafari A, Zadehahmad Z, Armanmehr V, Talebi M, Tehrani H. The evaluation of the role of diabetes health literacy and health locus of control on quality of life among type 2 diabetes using the Path analysis. Scientific Reports. 2023;13(1):5447.
https://doi.org/10.1038/s41598-023-32348-3
PMid:37012271 PMCid:PMC10070490  
 
5. literacy. Iomuroh. Measures of health literacy: workshop summary. Washington (DC): National Academies Press (US);. 2009.  
 
6. Ghanbari S, Ramezankhani A, Montazeri A, Mehrabi Y. Health literacy measure for adolescents (helma): development and psychometric properties. PloS one. 2016;11(2):e0149202.
https://doi.org/10.1371/journal.pone.0149202
PMid:26881933 PMCid:PMC4755574  
 
7. Tavousi M, Ebadi M, Fattahi E, Jahangiry L, Hashemi A, Hashemiparast M, et al. Health Literacy Measures: A Systematic Review Of The Literature. Payesh. 2015;14(4):-.  
 
8. Taghizadeh Z, Ebadi A, Montazeri A, Shahvari Z, Tavousi M, Bagherzadeh R. Psychometric properties of health related measures. Part 1: Translation, development, and content and face validity. Health monitor journal of the iranian institute for health sciences research. 2017;16(3):343-57.  
 
9. Ebadi A, Taghizadeh Z, Montazeri A, Shahvari Z, Tavousi M, Bagherzadeh R. Translation, development and psychometric properties of health related measures-Part 2: construct validity, reliability and responsiveness. Health Monitor Journal of the Iranian Institute for Health Sciences Research. 2017;16(4):445-55.  
 
10. Hinkin TR. A review of scale development practices in the study of organizations. Journal of Management. 1995;21(5):967-88.
https://doi.org/10.1177/014920639502100509  
 
11. Ghaffari M, Rakhshanderou S, Ramezankhani A, Mehrabi Y, Safari-Moradabadi A. Protocol of the TOHLA instrument: A Test of Oral Health Literacy in Adults. Journal of Education and Health Promotion. 2020;9(1):11-.  
 
12. Morgado FFR, Meireles JFF, Neves CM, Amaral ACS, Ferreira MEC. Scale development: ten main limitations and recommendations to improve future research practices. Psicologia: Reflexão e Crítica. 2017;30(1):3.
https://doi.org/10.1186/s41155-016-0057-1
PMid:32025957 PMCid:PMC6966966  
 
13. Harnett S. Health literacy tool shed: a source for validated health literacy instruments. Journal of Consumer Health on the Internet. 2017;21(1):78-86.
https://doi.org/10.1080/15398285.2017.1280344  
 
14. Osborne RH, Batterham RW, Elsworth GR, Hawkins M, Buchbinder R. The grounded psychometric development and initial validation of the Health Literacy Questionnaire (HLQ). BMC public health. 2013;13(1):1-17.
https://doi.org/10.1186/1471-2458-13-658
PMid:23855504 PMCid:PMC3718659  
 
15. Chinn D, McCarthy C. All Aspects of Health Literacy Scale (AAHLS): developing a tool to measure functional, communicative and critical health literacy in primary healthcare settings. Patient education and counseling. 2013;90(2):247-53.
https://doi.org/10.1016/j.pec.2012.10.019
PMid:23206659  
 
16. Tavousi M, Haeri-Mehrizi A, Rakhshani F, Rafiefar S, Soleymanian A, Sarbandi F, et al. Development and validation of a short and easy-to-use instrument for measuring health literacy: the Health Literacy Instrument for Adults (HELIA). BMC public health. 2020;20(1):1-11.
https://doi.org/10.1186/s12889-020-08787-2
PMid:32397970 PMCid:PMC7216550  
 
17. Haun J, Luther S, Dodd V, Donaldson P. Measurement variation across health literacy assessments: implications for assessment selection in research and practice. Journal of health communication. 2012;17(sup3):141-59.
https://doi.org/10.1080/10810730.2012.712615
PMid:23030567  
 
18. Chew LD, Bradley KA, Boyko EJ. Brief questions to identify patients with inadequate health literacy. 2004.  
 
19. Nakayama K, Osaka W, Togari T, Ishikawa H, Yonekura Y, Sekido A, et al. Comprehensive health literacy in Japan is lower than in Europe: a validated Japanese-language assessment of health literacy. BMC public health. 2015;15(1):1-12.
https://doi.org/10.1186/s12889-015-1835-x
PMid:26001385 PMCid:PMC4491868  
 
20. Manganello JA, DeVellis RF, Davis TC, Schottler-Thal C. Development of the health literacy assessment scale for adolescents (HAS-A). Journal of communication in healthcare. 2015;8(3):172-84.
https://doi.org/10.1179/1753807615Y.0000000016
PMid:27656257 PMCid:PMC5027646  
 
21. Dumenci L, Matsuyama R, Riddle DL, Cartwright LA, Perera RA, Chung H, et al. Measurement of cancer health literacy and identification of patients with limited cancer health literacy. Journal of health communication. 2014;19(sup2):205-24.
https://doi.org/10.1080/10810730.2014.943377
PMid:25315594 PMCid:PMC4283207  
 
22. Sabbahi DA, Lawrence HP, Limeback H, Rootman I. Development and evaluation of an oral health literacy instrument for adults. Community dentistry and oral epidemiology. 2009;37(5):451-62.
https://doi.org/10.1111/j.1600-0528.2009.00490.x
PMid:19740249  
 
23. Osborn CY, Wallston KA, Shpigel A, Cavanaugh K, Kripalani S, Rothman RL. Development and validation of the general health numeracy test (GHNT). Patient education and counseling. 2013;91(3):350-6.
https://doi.org/10.1016/j.pec.2013.01.001
PMid:23433635 PMCid:PMC3644342  
 
24. Zhang X-H, Thumboo J, Fong K-Y, Li S-C. Development and validation of a functional health literacy test. The Patient: Patient-Centered Outcomes Research. 2009;2(3):169-78.
https://doi.org/10.2165/11314850-000000000-00000
PMid:22273168  
 
25. Ousseine YM, Rouquette A, Bouhnik A-D, Rigal L, Ringa V, Smith AB, et al. Validation of the French version of the Functional, Communicative and Critical Health Literacy scale (FCCHL). Journal of patient-reported outcomes. 2018;2(1):1-6.
https://doi.org/10.1186/s41687-018-0027-8
PMid:29757319 PMCid:PMC5934921  
 
26. Steckelberg A, Hülfenhaus C, Kasper J, Rost J, Mühlhauser I. How to measure critical health competences: development and validation of the Critical Health Competence Test (CHC Test). Advances in health sciences education. 2009;14(1):11-22.
https://doi.org/10.1007/s10459-007-9083-1
PMid:17902033  
 
27. Teufl L, Vrtis D, Felder-Puig R. QUIGK-K: Quiz zur Erhebung von Gesundheitskompetenz bei Kindern. Prävention Und Gesundheitsförderung. 2020;15(3):250-5.
https://doi.org/10.1007/s11553-019-00749-w  
 
28. Koo M, Norman CD, Hsiao-Mei C. Psychometric evaluation of a Chinese version of the eHealth literacy scale (eHEALS) in school age children. Global Journal of Health Education and Promotion. 2012;15(1).  
 
29. Pan FC, Su C-L, Chen C-H. Development of a health literacy scale for Chinese-speaking adults in Taiwan. Int J Biolog Life Sci. 2010;6:150-6.  
 
30. White III RO, Osborn CY, Gebretsadik T, Kripalani S, Rothman RL. Development and validation of a Spanish diabetes-specific numeracy measure: DNT-15 Latino. Diabetes technology & therapeutics. 2011;13(9):893-8.
https://doi.org/10.1089/dia.2011.0070
PMid:21714674 PMCid:PMC3160266  
 
31. Nolte S, Osborne RH, Dwinger S, Elsworth GR, Conrad ML, Rose M, et al. German translation, cultural adaptation, and validation of the Health Literacy Questionnaire (HLQ). PloS one. 2017;12(2):e0172340.
https://doi.org/10.1371/journal.pone.0172340
PMid:28234987 PMCid:PMC5325258  
 
32. Rouquette A, Nadot T, Labitrie P, Van den Broucke S, Mancini J, Rigal L, et al. Validity and measurement invariance across sex, age, and education level of the French short versions of the European Health Literacy Survey Questionnaire. PloS one. 2018;13(12):e0208091.
https://doi.org/10.1371/journal.pone.0208091
PMid:30521552 PMCid:PMC6283623  
 
33. Doustmohammadian A, Omidvar N, Keshavarz-Mohammadi N, Abdollahi M, Amini M, Eini-Zinab H. Developing and validating a scale to measure Food and Nutrition Literacy (FNLIT) in elementary school children in Iran. PloS one. 2017;12(6):e0179196.
https://doi.org/10.1371/journal.pone.0179196
PMid:28654646 PMCid:PMC5487019  
 
34. Carpenter S. Ten steps in scale development and reporting: a guide for researchers. Communication methods and measures. 2018;12(1):25-44.
https://doi.org/10.1080/19312458.2017.1396583  
 
35. Montazeri A, Tavousi M, Rakhshani F, Seyed Ali A, Jahangiri K, Ebadi M, et al. Health literacy for iranian adults (helia): development and psychometric properties. Health monitor journal of the iranian institute for health sciences research. 2014;13(5):589-99.  
 
36. Liu T, Su X, Li N, Sun J, Ma G, Zhu W. Development and validation of a food and nutrition literacy questionnaire for Chinese school-age children. PloS one. 2021;16(1):e0244197.
https://doi.org/10.1371/journal.pone.0244197
PMid:33406105 PMCid:PMC7787443  
 
Journal of Health Literacy
Volume 8, Issue 3 - Serial Number 31
September 2023
Pages 90-102

Files

Share

How to cite

Statistics