Hostname: page-component-669899f699-ggqkh Total loading time: 0 Render date: 2025-05-04T10:43:13.977Z Has data issue: false hasContentIssue false
  • English
  • Français

Development of the Nurse Competency Assessment Scale in Disaster Management and Psychometric Testing

Published online by Cambridge University Press:  19 November 2024

Ayşe Yildiz Keskin Open the ORCID record for Ayşe Yildiz Keskin [Opens in a new window]  and
Handan Alan Open the ORCID record for Handan Alan [Opens in a new window]
Ayşe Yildiz Keskin*
Affiliation:
Department of Nursing Management, Mersin University, Faculty of Nursing, Mersin, Turkey
Handan Alan
Affiliation:
Department of Nursing Management, Istanbul University-Cerrahpaşa, Florence Nightingale Faculty of Nursing, Istanbul, Turkey
*
Corresponding author: Ayşe Yildiz Keskin; Email: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

Objective

The aim of this study was to develop the Nurse Competency Assessment Scale in Disaster Management (NCASDM) and to conduct psychometric evaluation.

Methods

It is a scale development study. Research data were collected between January and May 2023. In the sample of the study, as stated in the literature, it was aimed to reach at least 10 times the number of draft scale items (n = 600). The psychometric properties of the scale were tested with 697 nurses working in four different hospitals. A three-stage structure was used in the analysis of data: (1) creating the item pool, (2) preliminary evaluation of items, (3) refining of the scale and evaluation of psychometric properties. The content validity, construct validity, internal consistency, and temporal stability of the scale were evaluated according to the scale development guidelines.

Results

The scale items were obtained from online, semi-structured, in-depth individual interviews conducted with nurses who experienced disasters or worked in disasters. The content validity index of the scale was found to be 0.95. According to the exploratory factor analysis, it was found that the scale consisted of 43 items and two subscales, and the subscales explained 79.094% of the total variance. The compliance indices obtained as a result of confirmatory factor analysis were acceptable and at good levels.

Conclusions

The NCASDM was found to be a psychometrically valid and reliable measurement tool. It can be used to evaluate the competency of nurses related to disaster management.

Keywords

nursedisaster managementcompetencyreliabilityscale developmentvalidity
Type
Original Research
Information
Disaster Medicine and Public Health Preparedness , Volume 18 , 2024 , e273
Copyright
© The Author(s), 2024. Published by Cambridge University Press on behalf of Society for Disaster Medicine and Public Health, Inc

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

References

United Nations publication; International Strategy for Disaster Reduction (ISDR). Living with risk: a global review of disaster reduction initiatives (Volume 1). Geneva. 2004. From http://www.unisdr.org/files/657_lwr1.pdfn. Accessed January 10, 2024.Google Scholar
Kalanlar, B. Effects of disaster nursing education on nursing students’ knowledgeand preparedness for disasters. Int J Disaster Risk Reduct. 2018;28:475–480. https://doi.org/10.1016/j.ijdrr.2017.12.008CrossRefGoogle Scholar
Park, HY, Kim, JS. Factors influencing disaster nursing core competencies of emergency nurses. Appl Nurs Res. 2017;37:1–5. doi:10.1016/j.apnr.2017.06.004CrossRefGoogle ScholarPubMed
IFRC, World Disasters Report 2020, https://www.ifrc.org/document/world-disasters-report-2020Google Scholar
EM-DAT, 2022, Disaster in numbers. 2022_EMDAT_report.pdfGoogle Scholar
Emergency and Disaster Management Presidency, AFAD. Types of disasters. Accessed October 1, 2024. https://www.afad.gov.tr/afet-turleri.Google Scholar
Taşkıran, G, Baykal, U. Disasters and nurses’ preparedness for disasters in Turkey: literatüre review. J Health Nurs Manag. 2017;4(2):79–88. doi:10.5222/SHYD.2017.079.Google Scholar
Taskiran, G, Baykal, U. Nurses’ disaster preparedness and core competencies in Turkey: a descriptive correlational design. Int Nurs Rev. 2019;66(2):165–175. doi:10.1111/inr.12501CrossRefGoogle Scholar
Barrimah, I, Adam, I, Al-Mohaimeed, A. Disaster medicine education for medical students: Is it a real need? Med Teach. 2016;38:S60–S65. doi:10.3109/0142159X.2016.1142515CrossRefGoogle ScholarPubMed
Veenema, TG. Disaster Nursing and Emergency Preparedness for Chemical, Biological, and Radiological Terrorism, and Other Hazards. Fourth edition. Springe Publishing Company LLC; 2019.Google Scholar
İytemür, A, Yeşil, ST. Examining the opinions of nurses working in a university hospital regarding hospital disaster and emergency plans. Hacettepe Uni. Fac. of Nurs. J. 2020;7(2):138–148.Google Scholar
Zhou, W, Turale, S, Stone, TE, et al. Chinese nurses’ relief experiences following two earthquakes: implications for disaster education and policy development. Nurs Edu Prac. 2015;15:75–81. https://doi.org/10.1016/j.nepr.2014.06.011Google Scholar
United Nations Office for Disaster Risk Reduction, UNDRR. (2023) Disaster Management, Terminology. https://www.undrr.org/terminology. Accessed January 10, 2024.Google Scholar
The International Federation of Red Cross and Red Crescent Societies (IFRC), 2020. About Disaster Management. https://www.ifrc.org/taxonomy/term/2277. Accessed January 10, 2024.Google Scholar
World Health Organization. International Council of Nurses ICN framework of disaster nursing competencies. Geneva, Switzerland: World Health Organization and International Council of Nurses; 2009. Contract.Google Scholar
ICN. ICN on Regulation: Towards 21st century models. Geneva: International Council of Nurses; 1997.Google Scholar
Thobaity, AA, Plummer, V, Williams, B. What are the most common domains of the core competencies of disaster nursing? A scoping review. Inter Emer Nurs. 2017;31:64–71. https://doi.org/10.1016/j.ienj.2016.10.003CrossRefGoogle ScholarPubMed
International Council of Nurses. Core Competencies in Disaster Nursing Version Geneva, Switzerland: ICN_Disaster-Comp-Report_WEB.pdf; 2019.Google Scholar
Stoto, MA, Savoia, E, Nelson, C, et al. Development of a public health emergency preparedness competency model for European Union countries. Eurosurveillance. 2018;23(49):1700631. https://doi.org/10.2807/1560-7917.ES.2018.23.48.1700631CrossRefGoogle ScholarPubMed
Sultan, MAS, Khorram-Manesh, A, Carlström, E, et al. Nurses’ readiness for emergencies and public health challenges—the case of Saudi Arabia. Sustainability. 2020;12(19):7874. https://doi.org/10.3390/su12197874CrossRefGoogle Scholar
Said, NB, Chiang, VCL. The knowledge, skill competencies, and psychological preparedness of nurses for disasters: a systematic review. Int Emerg Nurs. 2020;48:100806. https://doi.org/10.1016/j.ienj.2019.100806CrossRefGoogle ScholarPubMed
EM_DAT, 2023 Earthquakes in Türkiye, 2023.https://files.emdat.be/2023/09/CredCrunch72.pdfGoogle Scholar
Nursing Regulation (2010). Official newspaper of Turkey, 27515, March 8, 2010.Google Scholar
Hospıtal Dısaster And Emergency Plans Implementatıon Regulatıon. Official newspaper of Turkey, 31072, March 18, 2020.Google Scholar
Glow, SD, Colucci, VJ, Allington DR, et al.Managing multiple-casualty incidents: a rural medical preparedness training assessment. Prehosp Disaster Med. 2013;28(4):334–341. doi:10.1017/S1049023X13000423CrossRefGoogle Scholar
Tzeng, WC, Feng, HP, Cheng, WT, et al. Readiness of hospital nurses for disaster responses in Taiwan: a cross-sectional study. Nurse Educ Today. 2016;47:37–42. doi:10.1016/j.nedt.2016.02.025CrossRefGoogle ScholarPubMed
Labrague, LJ, Hammad, K, Gloe, DS, et al. Disaster preparedness among nurses: a systematic review of literature. Int Nurs Rev. 2018;65(1):41–53. doi:10.1111/inr.12369CrossRefGoogle ScholarPubMed
Liou, SR, Liu, HC, Tsai, HM, et al. Relationships between disaster nursing competence, anticipatory disaster stress and motivation for disaster engagement. Int J Disaster Risk Reduct. 2020;47:101545. doi:10.1016/j.ijdrr.2020.101545CrossRefGoogle ScholarPubMed
Alan, H, Eskici, GT, Sen, HT, et al. Nurses’ disaster core competencies and resilience during the COVID-19 pandemic: a cross-sectional study from Turkey. J Nurs Manag. 2022;30(3):622–632. doi:10.1111/jonm.13552CrossRefGoogle ScholarPubMed
Celik, F. Disaster Preparedness Status of Nurses Working at Turkish Red Crescent. Unpublished Master’s Thesis, Istanbul University Institute of Health Sciences, Istanbul; 2010.Google Scholar
Al Thobaity, A, Williams, B, Plummer, V. A new scale for disaster nursing core competencies: development and psychometric testing. Australas Emerg Nurs J. 2016;19(1):11–19. doi:10.1016/j.aenj.2015.12.001CrossRefGoogle ScholarPubMed
Ahn, OH, Jang, EH. Kim, SH Development of the disaster nursing preparedness· response competency (DNPRC) scale in terms of convergence. J Korea Converg Soc, 2017;8(7):101–11.Google Scholar
Aliakbari, F, Aein, F, Bahrami, M, et al. Development, psychometric testing, and use of a disaster nursing competency scale in Iran: a mixed methods study. Disaster Med Public Health Prep. 2022;16(5):2108–2113. doi:10.1017/dmp.2021.197CrossRefGoogle ScholarPubMed
Boateng, GO, Neilands, TB, Frongillo, EA, et al. Best practices for developing and Validating scales for health, social, and behavioral research: a primer. Front Public Health. 2018;6:149. doi:10.3389/fpubh.2018.00149CrossRefGoogle ScholarPubMed
DeVellis, RF, Thorpe, CT. Scale Development: Theory and Applications. Sage Publications; 2021.Google Scholar
DeVellis, RF. Scale Development: Theory and Spplications (4th ed.). Sage Publications; 2017.Google Scholar
Carpenter, S. Ten steps in scale development and reporting: a guide for researchers. Commun Methods Meas. 2018;12(1):25–44. https://doi.org/10.1080/19312458.2017.1396583CrossRefGoogle Scholar
Onwuegbuzie, AJ, Bustamante, RM. Nelson, JA Mixed research as a tool for developing quantitative instruments. J Mix Methods Res. 2010;4(1):56–78. https://doi.org/10.1177/1558689809355805CrossRefGoogle Scholar
Zhou, Y. A mixed methods model of scale development and validation analysis. Meas Interdiscip Res. 2019;17(1):38–47. https://doi.org/10.1080/15366367.2018.1479088Google Scholar
Davis, LL. Instrument review: Getting the most from a panel of experts. App Nurs Res. 1992;5(4):194–197. https://doi.org/10.1016/S0897-1897(05)80008-4CrossRefGoogle Scholar
Grant, JS, Davis, LL. Selection and use of content experts for instrument development. Res Nurs Health. 1997;20(3):269–274. doi:10.1002/(sici)1098-240x(199706)20:3<269::aidnur9>3.0.co;2-g3.0.CO;2-G>CrossRefGoogle ScholarPubMed
Epstein, J, Santo, RM, Guillemin, F. A review of guidelines for cross-cultural adaptation of questionnaires could not bring out a consensus. J Clin Epidemiol. 2015;68(4):435–441. doi:10.1016/j.jclinepi.2014.11.021CrossRefGoogle Scholar
Field, A. Discovering Statistics Using IBM SPSS Statistics, 5th Editon. Sage Publications; 2018.Google Scholar
Kartal, M, Bardakçi, S. Reliability and Validity Analysis with SPSS and AMOS Applied Examples. Akademisyen Publishing; 2018.Google Scholar
Brahma, SS. Assessment of construct validity in management research: a structured guideline. J Manag Res. 2009;9(2):59–71. http://www.indianjournals.com/ijor.aspx?target=ijor:jmr&volume=9&issue=2&article=001Google Scholar
Yaşlioğlu M, M. Factor analysis and validity in social sciences: application of exploratory and confirmatory factor analyses. Istanbul Business Research. 2017;46:74–85. https://dergipark.org.tr/en/pub/iuisletme/issue/32177/357061Google Scholar
Alavi, M, Visentin, DC, Thapa, DK, et al. Exploratory factor analysis and principal component analysis in clinical studies: which one should you use?. J Adv Nurs. 2020;76(8):1886–1889. doi:10.1111/jan.14377CrossRefGoogle ScholarPubMed
Şencan, H. Factor Analysis and Validity. Validity and Reliability. 1st Edition. Ankara. Seçkin Publishing; 2005:355–414.Google Scholar
Child, D. The Essentials of Factor Analysis. A&C Black; 2006.Google Scholar
Sport, Alpar R., Health and Applied Statistics and Validity-Reliability with EExamples from Educational Sciences. Detay Publishing; 2016.Google Scholar
Çokluk, Ö, Şekercioğlu, G, Büyüköztürk, Ş. Multivariate Statistics SPSS and LISREL Applications for Social Sciences. Pegem Academy Publications; 2018.Google Scholar
Weir, JP. Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. J Strength Cond Res. 2005;19(1):231–240. doi:10.1519/15184.1Google ScholarPubMed
Tabachnick, BG. Fidell, LS. Using Multivariate Statistics (7th ed.). Pearson. Allyn & Bacon Publication; 2019.Google Scholar
Worthington, RL. Whittaker, TA. Scale development research: a content analysis and recommendations for best practices. The Counseling Psychologist. 2006;34(6):806–838. https://doi.org/10.1177/0011000006288127CrossRefGoogle Scholar
Yong, AG, Pearce, S. A beginner’s guide to factor analysis: focusing on exploratory factor analysis. Tutor Quant Methods Psychol. 2013;9(2):79–94. https://doi.org/10.20982/tqmp.09.2.p079CrossRefGoogle Scholar
Talbot, L. Principles and Practice of Nursing Research. Mosby Year Book; 1995:197–216.Google Scholar
Brown, TA. Confirmatory Factor Analysis for Applied Research (2nd ed.). Guilford Publications; 2015.Google Scholar
Newsom, JT. Minimum sample size recommendations (Psy 523/623 structural equation modeling Spring 2018). Manuscript Retrieved from upa. pdx. edu/IOA/newsom/semrefs.htm.Google Scholar
Evans, CA, Baumberger-Henry, M. Readiness: how prepared are you?. J Emerg Nurs. 2014;40(5):448–452. doi:10.1016/j.jen.2014.03.006CrossRefGoogle ScholarPubMed
Jackson, D, Bradbury-Jones, C, Baptiste, D, et al. Life in the pandemic: some reflections on nursing in the context of COVID-19. J Clin Nurs. 2020;29(13-14):2041–2043. doi:10.1111/jocn.15257CrossRefGoogle ScholarPubMed
Polit, DF, Beck, CT, Owen, SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30(4):459–467. doi:10.1002/nur.20199CrossRefGoogle ScholarPubMed
Schmitt, TA. Current methodological considerations in exploratory and confirmatory factor analysis. J Psychoedu Assess. 2011;29(4):304–321. https://doi.org/10.1177/0734282911406653CrossRefGoogle Scholar
Kline, R. Principles and Practice of Structural Equation Modeling (4th ed.). Guilford Publications; 2015.Google Scholar
Wang, J, Wang, X. Structural Equation Modeling: Applications Using Mplus. (2. bs). John Wiley & Sons; 2019.CrossRefGoogle Scholar
Bagozzi, RP, Kimmel, SK. A comparison of leading theories for the prediction of goal directed behaviours. Brit J Soc Psychol. 1995;34(4):437–461. https://doi.org/10.1111/j.2044-8309.1995.tb01076.xCrossRefGoogle Scholar
Büyüköztürk, Ş. Handbook of Data Analysis for Social Sciences Statistics , Research Design SPSS Applications and Interpretation (23rd ed.). Ankara: Pegem Akademi; 2017:179–194.Google Scholar