The Imperative Of Evaluating Psychometric Properties Of Scales For Accurate Measurement: A Review
Main Article Content
Abstract
Scale development and validation represent fundamental processes in various disciplines within health, social, and behavioral sciences. However, the methodologies involved can be complex, laden with specialized terminology, unfamiliar to many, and demanding in terms of resources. Moreover, these processes are often not adequately covered in graduate education. Therefore, our aim was to succinctly outline the procedures of scale development in a clear manner, with the dual objectives of facilitating the creation of new, valid, and reliable scales, and enhancing the quality of existing ones. To achieve this, we have compiled a guide outlining best practices for developing scales to measure intricate phenomena. This guide is not a comprehensive systematic review but rather a synthesis of technical literature and insights gleaned from our extensive experience in developing or adapting various scales over several decades. We have identified three overarching phases encompassing nine specific steps. The initial phase involves generating items and assessing their content validity. Subsequently, in the scale construction phase, activities include pre-testing questions, survey administration, item reduction, and determining the scale's dimensionality. Finally, in the scale evaluation phase, dimensionality and reliability testing, as well as validity assessment, are conducted. Throughout the guide, we have incorporated illustrative examples of best practices for each step. In summary, this primer aims to empower both researchers and practitioners to comprehend the conceptual and methodological aspects of scale development and validation, thereby fostering advancements in our understanding of various health, social, and behavioral outcomes.
Article Details
References
Abbot S, Proudman S, Sim YP, Williams N. Psychometric properties of patient-reported outcomes measures used to assess upper limb pathology: a systematic review. ANZ J Surg. 2022 Dec;92(12):3170-3175. doi: 10.1111/ans.17973. Epub 2022 Aug 12. PMID: 35959939; PMCID: PMC10087017.
Palaskar, P., Attry, S., Malani, R., Gugnani, A., Kale, A., & Sant, N. (2023). Development and validation of Scale for Prediction of Ambulation in Indian Children with Cerebral Palsy- The SPAIC scale. Medical Science, 27(138), 1–22. https://doi.org/10.54905/disssi/v27i138/e332ms3073
Gagnier JJ, Shen Y, Huang H. Psychometric properties of patient-reported outcome measures for use in patients with anterior cruciate ligament injuries: a systematic review. JBJS reviews. 2018 Apr 1;6(4):e5.
Emerson Kavchak, A. J., Mischke, J. J., Lulofs-MacPherson, K., & Vendrely, A. M. (2014). The psychometric properties of self-report outcome measures in temporomandibular dysfunction. Physical Therapy Reviews, 19(3), 174–185. https://doi.org/10.1179/1743288X13Y.0000000126
Weldring T, Smith SM. Patient-Reported Outcomes (PROs) and Patient-Reported Outcome Measures (PROMs). Health Serv Insights. 2013 Aug 4;6:61-8. doi: 10.4137/HSI.S11093. PMID: 25114561; PMCID: PMC4089835.
Du B, Lakshminarayanan M, Krishna M, Vaitheswaran S, Chandra M, Kunnukattil Sivaraman S, Goswami SP, Rangaswamy T, Spector A, Stoner CR. Psychometric properties of outcome measures in non-pharmacological interventions of persons with dementia in low-and middle-income countries: A systematic review. Psychogeriatrics. 2021 Mar;21(2):220-238. doi: 10.1111/psyg.12647. Epub 2020 Dec 17. PMID: 33336529; PMCID: PMC7986620.
Blower SL, Gridley N, Dunn A, Bywater T, Hindson Z, Bryant M. Psychometric Properties of Parent Outcome Measures Used in RCTs of Antenatal and Early Years Parent Programs: A Systematic Review. Clin Child Fam Psychol Rev. 2019 Sep;22(3):367-387. doi: 10.1007/s10567-019-00276-2. PMID: 30796674; PMCID: PMC6669247.