Key Criteria for Selecting Measurement Instruments in Health Disciplines
Article Sidebar
Main Article Content
Abstract
Background: Validity and reliability are frequently misinterpreted and improperly applied in various types of studies. Therefore, it is essential for healthcare professionals to use appropriate measurement instruments for assessing subjective attributes and complex dimensions. This ensures accurate interpretation of evidence and improves medical care. Objective: To propose useful criteria for selecting appropriate measurement instruments in the health field to evaluate variables of interest. Methods: A literature review was conducted. Using search algorithms in various databases, narrative and systematic reviews published between 2000 and 2023 that addressed measurement instruments were selected. Results: Of the 351 articles initially identified, 62 met the selection criteria. The key criteria considered for selecting measurement instruments included cultural adaptation, reliability, validity of theoretical constructs, validity of empirical constructs (criterion and construct), and responsiveness. The most relevant aspects of these criteria were defined, classified, and analyzed in terms of their usefulness. Conclusions: Selecting measurement instruments for variables that cannot be directly measured requires a thorough search and evaluation of the properties described in this article. These criteria provide a more objective approach to selecting measurement tools, enabling more precise assessments of the phenomena under study from both qualitative and quantitative perspectives.
Downloads
Article Details
Citas en Dimensions Service
References
Luján-Tangarife JA, Cardona-Arias JA. Construcción y validación de escalas de medición en salud: revisión de propiedades psicométricas. Arch Med. 2015;11(3):1-10.
Manzano Patiño AP. Introducción a los modelos de ecuaciones estructurales. Investig Educ Médica. 2018;7(25):67-72.
Batista-Foguet JM, Coenders G, Alonso J. Análisis factorial confirmatorio. Su utilidad en la validación de cuestionarios relacionados con la salud. Med Clin (Barc). 2004;122(Supl 1):21-27.
Sánchez PR, Gómez RC. Conceptos básicos sobre la validación de escalas. Rev Col Psiquiatr. 1998;27(2):121-130.
Sánchez R, Echeverry J. Validación de escalas de medición en salud. Rev Salud Pública (Bogotá). 2004;6(3):302-318.
Lara M, Ortega H. ¿Clinimetría o Psicometría? Medición en la práctica psiquiátrica. Salud Ment. 1995;18(4):33-40.
Beckman TJ, Ghosh AK, Cook DA, et al. How reliable are assessments of clinical teaching? J Gen Intern Med. 2004;19:971-977.
Ramada-Rodilla JM, Serra-Pujadas C, Delclós-Clanchet GL. Adaptación cultural y validación de cuestionarios de salud: revisión y recomendaciones metodológicas. Salud Publica Mex. 2013;55(1):57-66.
Feinstein AR. Clinimetric perspectives. J Chronic Dis. 1987;40(6):635-640.
Streiner DL, Norman GR. Health measurement scales: A practical guide to their development and use. 5th ed. Oxford: Oxford University Press; 1995.
Nunnally JC, Bernstein IJ. Teoría psicométrica. México: McGraw-Hill; 1995.
Nunnally JC. Introducción a la medición psicológica. Buenos Aires: Paidós; 1977.
Meneses J, Barrios M, Bonillo A, Cosculluela A, Lozano LM, Turbani J, Valero S. Psicometría. Barcelona: Editorial UOC; 2013.
Ramos VZ. Psicometría básica. Bogotá: Fundación Universitaria del Área Andina; 2018.
González LLFM. Instrumentos de evaluación psicológica. La Habana: Editorial Ciencias Médicas; 2007.
Cortada De K. Importancia de la investigación psicométrica. Rev Lat Psic. 2002;34(3):229-240.
Aragón B. Fundamentos psicométricos en la evaluación psicológica. Rev Elect Psic Iztacala. 2004;7(4):23-43.
Devet H, Terwee C, Bouter L. Clinimetrics and psychometrics: two sides of the same coin. J Clin Epidemiol. 2003;56(12):1146-1147.
Scientific Advisory Committee of the Medical Outcomes Trust. Assessing health status and quality-of-life instruments: attributes and review criteria. Qual Life Res. 2002;11:193-205.
American Educational Research Association, American Psychological Association, National Council on Measurement in Education. Standards for educational and psychological testing. Washington, DC: American Educational Research Association; 1999.
Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42.
Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539-549.
Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-745.
Lamprea M, Gómez-Restrepo C. Validez en la evaluación de escalas. Rev Colom Psiquiat. 2007;36(2):340-348.
Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46:1417-1432.
Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-3191.
Manterola C, Grande L, Otzen T, García N, Salazar P, Quiroz G. Confiabilidad, precisión o reproducibilidad de las mediciones. Métodos de valoración, utilidad y aplicaciones en la práctica clínica. Rev Chilena Infectol. 2018;35(6):680-688.
Kerlinger FN, Lee HB. Investigación del comportamiento. Métodos de investigación en ciencias sociales. 4ª ed. México: McGraw-Hill/Interamericana Editores; 2002. p. 581-602.
Streiner DL, Norman GL, Cairney J. Health measurement scales: A practical guide to their development and use. UK: Oxford University Press; 2015.
Hurley WL, Denegar CR, Hertel J. Métodos de investigación: Fundamentos de una práctica clínica basada en la evidencia. Barcelona: Wolkers Kluwer Health Lippincott Williams & Wilkins; 2012. p. 139-54.
Mcdowell I. Measuring health: A guide to rating scales and questionnaires. New York: Oxford University Press; 2006. p. 39-45.
Cascaes da Silva F, Gonçalves E, Valdivia Arancibia BA, Graziele Bento S, Da Silva Castro TL, Soleman Hernandez SS, et al. Estimadores de consistencia interna en las investigaciones en salud: el uso del coeficiente alfa. Rev Peru Med Exp Salud Publica. 2015;32(1):129-138.
George D, Mallery P. IBM SPSS Statistics 25 Step by step: A simple guide and reference. New York: Routledge/Taylor & Francis; 2019.
Streiner DL. Starting at the beginning: An introduction to coefficient alpha and internal consistency. J Pers Assess. 2003;80(1):99-103.
Évaluation des technologies de la santé [Internet] [citado 2024 mar 19]. Disponible en: https://htaglossary.net/fiabilidad-entre-observadores-(n.f.)
de Raadt A, Warrens MJ, Bosker RJ, Kiers HAL. A comparison of reliability coefficients for ordinal rating scales. J Classif. 2021;38(3):519-543.
Jacobsson U, Westergren A. Statistical methods for assessing agreement for ordinal data. Scand J Caring Sci. 2005;19:427-31.
Carvajal A, Centeno C, Watson R, Martínez M, Sanz Rubiales Á. ¿Cómo validar un instrumento de medida de la salud? An Sist Sanit Navar. 2011;34(1):63-72.
Bolarinwa O. Principles and methods of validity and reliability testing of questionnaires used in social and health science researches. Niger Postgrad Med J. 2015;22(4):195.
Escobar-Pérez J, Cuervo-Martínez A. Validez de contenido y juicio de expertos: una aproximación a su utilización. Avances Medición. 2008;6:27-36.
García de YPMA, Rodríguez SF, Carmona OL. Validación de cuestionarios. Reumatol Clin. 2009;5:171-177.
Tsang S, Royse C, Terkawi A. Guidelines for developing, translating, and validating a questionnaire in perioperative and pain medicine. Saudi J Anaesth. 2017;11(5):80-89.
Yusoff MSB. ABC of content validation and content validity index calculation. Educ Med J. 2019;11(2):49-54.
Pérez-Gil JA, Chacón MS, Moreno RF. Validez de constructo: el uso del análisis factorial exploratorio-confirmatorio para obtener evidencias de validez. Psicothema. 2000;12(2):442-446.
Montero RE. Referentes conceptuales y metodológicos sobre la noción moderna de validez de instrumentos de medición: implicaciones para el caso de personas con necesidades educativas especiales. Actual Psicol. 2013;27(114):113-128.
Soto J. Validez predictiva de los cuestionarios: ¿qué es y por qué es importante su conocimiento. Reumatol Clin. 2010;6(1):1-4.
Scannell JW, Bosley J, Hickman JA, Dawson GR, Truebel H, Ferreira GS, et al. Predictive validity in drug discovery: what it is, why it matters and how to improve it. Nat Rev Drug Discov. 2022;21(12):915-931.
Ahmed I, Ishtiaq S. Reliability and validity: Importance in Medical Research. J Pak Med Assoc. 2021;71(10):2401-2406.
DeVon HA, Block ME, Moyle-Wright P, Ernst DM, Hayden SJ, Lazzara DJ, et al. A psychometric toolbox for testing validity and reliability. J Nurs Scholarsh. 2007;39(2):155-164.
Strauss ME, Smith GT. Construct validity: advances in theory and methodology. Annu Rev Clin Psychol. 2009;5(1):1-25.
Anderson JL, Sellbom M. Construct validity of the DSM-5 Section III personality trait profile for borderline personality disorder. J Pers Assess. 2015;97(5):478-486.
Drost EA. Validity and reliability in social science research. Educ Res Perspect. 2011;38:105-123.
Carlson KD, Herdman AO. Understanding the impact of convergent validity on research results. Organ Res Methods. 2012;15(1):17-32.
Douglas H, Bore M, Munro D. Construct validity of a two-factor model of psychopathy. Psychology (Irvine). 2012;3(3):243-248.
Mcdowell I. Measuring Health: A guide to rating scales and questionnaires. New York: Oxford University Press; 2006. p. 53-4.
Dhillon HK, Zaini MZA, Quek KF, Singh HJ, Kaur G, Rusli BN. Exploratory and confirmatory factor analyses for testing validity and reliability of the Malay language questionnaire for urinary incontinence diagnosis (QUID). Open J Prev Med. 2014;4(11):844-851.
Shen F. Multitrait‐Multimethod Matrix. The International Encyclopedia of Communication Research Methods. Wiley; 2017. p. 1-6.
Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL. International consensus on taxonomy, terminology, and definitions of measurement properties: Results of the COSMIN study. J Clin Epidemiol. 2010;63:737-745.
Mokkink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: A clarification of its content. BMC Med Res Methodol. 2010;10:22.
Terwee CB. Responsiveness to Change. En: Encyclopedia of Quality of Life and Well-Being Research. Dordrecht: Springer Netherlands; 2014. p. 5547-50.
Kievit AJ, Kuijer PPFM, Kievit RA, Sierevelt IN, Blankevoort L, Frings-Dresen MHW. A reliable, valid and responsive questionnaire to score the impact of knee complaints on work following total knee arthroplasty: The WORQ. J Arthroplasty. 2014;29(6):1169-1175.e2.
De Vet H, Terwee CB, Mokkink LB, Knol DJ. Measurement in medicine. A practical guide. Cambridge: Cambridge University Press; 2011.
Reichenheim M, Bastos JL. What, what for and how? Developing measurement instruments in epidemiology. Rev Saude Publica. 2021;55:40.
Berry JW, Poortinga YH, Segall MH, Dasen PR. Cross-cultural psychology: research and applications. New York: Cambridge University Press; 2002.
Herdman M, Fox-Rushby J, Badia X. “Equivalence” and the translation and adaptation of health-related quality of life questionnaires. Qual Life Res. 1997;6(3):237-247.
Gómez-Clavelina FJ, Irigoyen-Coria AE, Ponce-Rosas ER. Selección y análisis de instrumentos para la evaluación de la estructura y funcionalidad familiar. Arch Med Fam. 1999;1(2):45-57.
Kimberlin CL, Winterstein AG. Validity and reliability of measurement instruments used in research. Am J Health Syst Pharm. 2008;65(23):2276-2284.
Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42.
Hamilton E, Carr A. Systematic review of self‐report family assessment measures. Fam Process. 2016;55(1):16-30.
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.