Psychometric properties of an instrument for assessing patient safety teaching and learning in higher education*

Authors

Keywords:

Nursing, Validation Study, Teaching, Learning, Patient Safety

Abstract

Objective: To develop and evaluate the psychometric properties of an instrument for assessing teaching and learning strategies on patient safety in the context of Nursing Higher Education.

Method: Methodological study conducted between February and April 2025, developed in three stages: literature review, instrument development, and psychometric validation. Content validity was assessed by 10 experts and 30 students. The instrument was administered to 195 students from five federal universities. The Content Validity Coefficient, Exploratory Factor Analysis, Composite Reliability, the H index, and item discrimination parameters based on Item Response Theory were used.

Results: The review identified 19 publications that supported the instrument's development. The Content Validity Coefficient was 0.91 (experts) and 0.93 (target audience). Factor analysis showed satisfactory factor loadings and high reliability.

Conclusion: The instrument demonstrated validity, a consistent factor structure, and high reliability, making it suitable for assessing teaching and learning strategies for patient safety in Higher Education.

Author Biographies

Adriely de Abreu Varoto, Federal University of Juiz de Fora, Juiz de Fora, MG, Brazil.

Nurse. Master's degree in Nursing, Federal University of Juiz de Fora, Juiz de Fora, MG, Brazil.

Diego Dias de Araújo, State University of Montes Claros, Montes Claros, Minas Gerais, Brazil.

Nurse. PhD in Nursing. Professor at the State University of Montes Claros, Montes Claros, Minas Gerais, Brazil.

Herica Silva Dutra, Federal University of Juiz de Fora, Juiz de Fora, MG, Brazil.

Nurse. PhD in Nursing. Professor at the Federal University of Juiz de Fora, Juiz de Fora, MG, Brazil.

Luciane Ribeiro, Federal University of Juiz de Fora, Juiz de Fora, MG, Brazil.

Nurse. PhD in Public Health. Professor at the Federal University of Juiz de Fora, Juiz de Fora, MG, Brazil.

Aires Garcia dos Santos Junior, Federal University of Mato Grosso do Sul, Três Lagoas, Mato Grosso do Sul, Brazil.

Nurse. PhD in Health. Professor at the Federal University of Mato Grosso do Sul, Três Lagoas, Mato Grosso do Sul, Brazil.

Fábio da Costa Carbogim, Federal University of Juiz de Fora, Juiz de Fora, MG, Brazil.

Nurse. PhD in Sciences. Professor at the Federal University of Juiz de Fora, Juiz de Fora, MG, Brazil.

Elenir Pereira de Paiva, Federal University of Juiz de Fora, Juiz de Fora, MG, Brazil.

Nurse. PhD in Nursing. Professor at the Federal University of Juiz de Fora, Juiz de Fora, MG, Brazil.

André Luiz Silva Alvim, Federal University of Juiz de Fora, Juiz de Fora, MG, Brazil.

Nurse. PhD in Nursing. Professor at the Federal University of Juiz de Fora, Juiz de Fora, MG, Brazil.

References

1. Ghezzi JFSA, Higa EFR, Lemes MA, Marin MJS. Strategies of active learning methodologies in nursing education: an integrative literature review. Rev Bras Enferm [Internet]. 2021 [cited 2025 Sep 5];74(1):e20200130. Available from: https://doi.org/10.1590/0034-7167-2020-0130

2. Challa KT, Sayed A, Acharya Y. Modern techniques of teaching and learning in medical education: a descriptive literature review. Med Ed Publish [Internet]. 2021 [cited 2025 Sep 5];10:18. Available from: https://doi.org/10.15694/mep.2021.000018.1

3. World Health Organization (WHO). Global patient safety action plan 2021-2030: towards eliminating avoidable harm in health care [Internet]. Geneva: WHO; 2021 [cited 2025 Sep 5]. 95 p. Available from: https://www.who.int/teams/integrated-health-services/patient-safety/policy/global-patient-safety-action-plan

4. Ferreira Netto N, de Paula VAA, Carneiro M, Püschel VAA, Carbogim FC, Alvim ALS. Teaching-learning strategies on patient safety in higher education institutions: a scoping review. Rev Bras Enferm [Internet]. 2025 [cited 2025 Sep 5];78:e20240270. Available from: https://doi.org/10.1590/0034-7167-2024-0270

5. Wong BM, Baum KD, Headrick LA, Holmboe ES, Moss F, Ogrinc G, et al. Building the bridge to quality: an urgent call to integrate quality improvement and patient safety education with clinical care. Acad Med [Internet]. 2020 [cited 2025 Sep 5];95(1):59-65. Available from: https://doi.org/10.1097/ACM.0000000000002937

6. Souza IS, Moniz MA, Louro TQ, Ribeiro CRB, Soares LS, Xavier BLS. Validação de conteúdo de tecnologia educacional para ensino de enfermagem em saúde ambiental. Cienc Enferm [Internet]. 2021 [cited 2025 Jul 20];27:26. Available from: http://dx.doi.org/10.29393/ce27-26vcib60026.

7. Bartoníčková D, Kohanová D, Cakirpaloglu SD, Steven A, Žiaková K. Exploring nursing students’ perspectives on patient safety culture in clinical settings: a mixed-method study. J Clin Nurs [Internet]. 2025 [cited 2025 Sep 5];34(7):2702-17. Available from: https://doi.org/10.1111/jocn.17812

8. Cantero-López N, González-Chordá VM, Valero-Chillerón MJ, Mena-Tudela D, Andreu-Pejó L, Vila-Candel R, et al. Attitudes of undergraduate nursing students towards patient safety: a quasi-experimental study. Int J Environ Res Public Health [Internet]. 2021 [cited 2025 Sep 5];18(4):1429. Available from: https://doi.org/10.3390/ijerph18041429

9. Gagnier JJ, Lai J, Mokkink LB, Terwee CB. COSMIN reporting guideline for studies on measurement properties of patient-reported outcome measures. Qual Life Res [Internet]. 2021 [cited 2025 Sept 5];30(8):2197-210. Available from: https://doi.org/10.1007/s11136-021-02822-4

10. Vinuto J. A amostragem em bola de neve na pesquisa qualitativa: um debate em aberto. tematicas [Internet]. 2014 [cited 2025 Sep 5];22(44):203-20. Available from: https://econtents.sbu.unicamp.br/inpec/index.php/tematicas/article/view/10977

11. Yusoff MSB. ABC of content validation and content validity index calculation. Educ Med J [Internet]. 2019 [cited 2025 Sep 5];11(2):49-54. Available from: https://doi.org/10.21315/eimj2019.11.2.6

12. Coluci MZO, Alexandre NMC, Milani D. Construção de instrumentos de medida na área da saúde. Cienc Saúde Colet [Internet]. 2015 [cited 2025 Sep 5];20(3):925-36. Available from: https://doi.org/10.1590/1413-81232015203.04332013

13. Asparouhov T, Muthén B. Simple second order chi-square correction. Stat Model [Internet]. 2010 [cited 2025 Sep 5];10(1):1-22. Available from: https://www.researchgate.net/publication/265745604_Simple_Second_Order_Chi-Square_Correction

14. Lorenzo-Seva U, Timmerman ME, Kiers HAL. The Hull method for selecting the number of common factors. Multivar Behav Res [Internet]. 2011 [cited 2025 Sep 5];46(2):340-64. Available from: https://doi.org/10.1080/00273171.2011.564527

15. Lorenzo-Seva U, Ferrando PJ. Robust Promin: a method for diagonally weighted factor rotation. Liberabit [Internet]. 2019 [cited 2025 Sep 5];25(1):99-106. Available from: http://www.scielo.org.pe/scielo.php?script=sci_arttext&pid=S1729-48272019000100008&lng=en

16. Brown TA. Confirmatory factor analysis for applied research. 2nd ed. New York: Guilford Press; 2015. 462 p.

17. Ferrando PJ, Lorenzo-Seva U. Assessing the quality and appropriateness of factor solutions and factor score estimates in exploratory item factor analysis. Educ Psychol Meas [Internet]. 2018 [cited 2025 Sep 5];78(5):762-80. Available from: https://doi.org/10.1177/0013164417719308

18. Reckase MD. The difficulty of test items that measure more than one ability. Appl Psychol Meas [Internet]. 1985 [cited 2025 Sep 5];9(4):401-12. Available from: https://doi.org/10.1177/014662168500900409

19. Mikkonen K, Tomietto M, Watson R. Instrument development and psychometric testing in nursing education research. Nurse Educ Today [Internet]. 2022 [cited 2025 Sep 5];119:105603. Available from: https://doi.org/10.1016/j.nedt.2022.105603

20. World Health Organization (WHO). Patient safety curriculum guide: multi-professional edition [Internet]. Geneva: WHO; 2011 [cited 2025 Sep 5]. 272 p. Available from: https://www.who.int/publications/i/item/9789241501958/

21. Eskici GT, Kanig M, Ugur E, Seren AKH. The Turkish version of the patient safety competency self-evaluation tool: a validity and reliability study. Nurse Educ Pract [Internet]. 2021 [cited 2025 Sep 5];57:103229. Available from: https://doi.org/10.1016/j.nepr.2021.103229

22. Moon S, Chang SJ. Comparing the effects of patient safety education using design thinking and case-based learning on nursing students’ competence and professional socialization: a quasi-experimental design. Heliyon [Internet]. 2024 [cited 2025 Sep 5];10(9):e29942. Available from: https://doi.org/10.1016/j.heliyon.2024.e29942

23. Abbasi M, Asadoola Y, Ebrahimi H, Bahonar E, Dabirian Z, Esmaeili SM, et al. Comparison of mannequin-based simulation training method with virtual training method on nursing students’ learning cardiopulmonary resuscitation: a controlled randomized parallel trial. Iran J Nurs Midwifery Res [Internet]. 2024 [cited 2025 Sep 5];29(4):438-45. Available from: https://doi.org/10.4103/ijnmr.ijnmr_222_23

24. Lee SE, Morse BL, Kim NW. Patient safety educational interventions: a systematic review with recommendations for nurse educators. Nurs Open [Internet]. 2022 [cited 2025 Sep 5];9(4):1967-79. Available from: https://doi.org/10.1002/nop2.955

25. Murray M, Sundin D, Cope V. New graduate nurses’ understanding and attitudes about patient safety upon transition to practice. J Clin Nurs [Internet]. 2019 [cited 2025 Sep 5];28(13-14):2543-52. Available from: https://doi.org/10.1111/jocn.14839

26. Alvim ALS, Gazzinelli A, Couto BRGM. Construction and validation of instrument to assess the quality of infection control programs. Rev Gaucha Enferm [Internet]. 2021 [cited 2025 Sep 5];42:e20200135. Available from: https://doi.org/10.1590/1983-1447.2021.20200135

27. Rodríguez Rojas G, Torres Reyes A, Hidalgo Arce I, Salazar Mendoza F, Pérez Vázquez G, Morales Castillo FA. Diseño, validación y confiabilidad del instrumento para prevenir infección del sítio quirúrgico. J Health NPEPS [Internet]. 2024 [cited 2025 Aug 6];9(1):93-106. Available from: https://doi.org/10.30681/2526101012243

28. Barreto MAF, Negreiros FDS, Cestari VRF, Sampaio HAC, Moreira TMM. Evidence of validity of the Risk Self-Medication Questionnaire focused on health literacy. Rev Bras Enferm [Internet]. 2024 [cited 2025 Sep 5];77(3):e20230386. Available from: https://doi.org/10.1590/0034-7167-2023-0386

29. Moraes KL, Brasil VV, Mialhe FL, Sampaio HAC, Sousa ALL, Canhestro MR, et al. Validation of the Health Literacy Questionnaire (HLQ) to Brazilian Portuguese. Acta Paul Enferm [Internet]. 2021 [cited 2025 Sep 5];34:eAPE02171. Available from: https://doi.org/10.37689/acta-ape/2021ao02171

30. Pereira FMP, de Almeida CS, Bastos AVB. Evidências de validade da Escala de Comprometimento com as Ações Docentes (ECAD). Aval Psicol [Internet]. 2024 [cited 2025 Sep 5];23(3):275-86. Available from: https://pepsic.bvsalud.org/scielo.php?script=sci_arttext&pid=S1677-04712024000300275

Downloads

Published

2026-07-21

How to Cite

Varoto, A. de A., de Araújo, D. D., Dutra, H. S., Ribeiro, L., dos Santos Junior, A. G., Carbogim, F. da C., … Alvim, A. L. S. (2026). Psychometric properties of an instrument for assessing patient safety teaching and learning in higher education*. Cogitare Enfermagem, 31. Retrieved from https://revistas.ufpr.br/cogitare/article/view/102517

Issue

Vol. 31 (2026)

Section

Technological Innovation

License

Copyright (c) 2026 Adriely de Abreu Varoto, Diego Dias de Araújo, Herica Silva Dutra, Luciane Ribeiro, Aires Garcia dos Santos Junior, Fábio da Costa Carbogim, Elenir Pereira de Paiva, André Luiz Silva Alvim

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Cogitare Enfermagem reserves the right to make normative, orthographic, and grammatical changes to the published article to maintain the cultured standard of the language, while respecting the authors' style.

The published study is the sole responsibility of the author(s), and Cogitare Enfermagem is exclusively responsible for evaluating the manuscript as a scientific publication vehicle. Revista Cogitare Enfermagem is not responsible for any violations of Law No. 9,610/1998, the Brazilian Copyright Law.

Cogitare Enfermagem allows the author to hold the copyright of articles accepted for publication, without restrictions.

The articles published are licensed under the Creative Commons license CC BY 4.0 Creative Commons - Attribution 4.0 International - CC BY 4.0 - The attribution adopted by Cogitare Enfermagem is permitted:

  • Share - copy and redistribute the material in any media or format.
  • Adapt - remix, transform and build upon the material for any purpose, even commercially.
  • Attribution - You must give proper credit, provide a link to the license, and indicate if changes have been made. You may do this in any reasonable way, but not in a way that suggests that the licensor endorses it or approves of its use.
  • No additional restrictions - You may not apply legal terms or technological measures that legally restrict others from doing something that the license allows.