Monitoring and evaluation in disaster management courses: a scoping review
Abstract Background Owing to the infrequent emergence of disasters and the challenges associated with their management, responders need appropriate training beyond doubt. Ensuring the highest standard of disaster management (DM) training is of paramount importance for high-quality DM. However, the l...
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2025-02-01
|
| Series: | BMC Medical Education |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12909-025-06659-0 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1823861970483281920 |
|---|---|
| author | George Teo Voicescu Hamdi Lamine Andra Elena Loșonți Eugenia Maria Lupan-Mureșan Sonia Luka José García Ulerio Luca Ragazzoni Francesco Della Corte Marta Caviglia |
| author_facet | George Teo Voicescu Hamdi Lamine Andra Elena Loșonți Eugenia Maria Lupan-Mureșan Sonia Luka José García Ulerio Luca Ragazzoni Francesco Della Corte Marta Caviglia |
| author_sort | George Teo Voicescu |
| collection | DOAJ |
| description | Abstract Background Owing to the infrequent emergence of disasters and the challenges associated with their management, responders need appropriate training beyond doubt. Ensuring the highest standard of disaster management (DM) training is of paramount importance for high-quality DM. However, the literature concerning DM training monitoring and evaluation (M&E) is scarce. The primary objective of this review was to document the existing M&E strategies for DM training. Methods The authors conducted a systematic literature search on June 28, 2023, on the PubMed, Scopus, Embase and Cochrane databases, including studies that described the learning objectives and the M&E strategy of DM training. The authors categorized the learning objectives and the evaluation methodology according to the revised Bloom’s Taxonomy and the New World Kirkpatrick model, respectively. Results Fifty-seven articles met the inclusion and exclusion criteria, described DM training targeting healthcare and non-healthcare professionals and employed diverse teaching methods and topics. Five studies reported using monitoring, while all reported an evaluation methodology. The learning objectives focused on students’ ability to “Remember” (N = 50) and “Apply”(N = 44). The evaluations centred around the second level of the New World Kirkpatrick model (N = 57), with only 7 articles investigating the third level. Sixteen authors used existing, validated M&E frameworks. When corelating the learning objectives with the evaluation methodology, the authors observed a mismatch, as skills like the students’ ability to “Apply” and “Create” were evaluated using the second level of the New World Kirkpatrick model. Conclusions The great heterogeneity in DM training highlights the particularity of these educational programs. The lack of monitoring and the low usage of existing M&E frameworks highlighted a lack of awareness and standardization in the field. The mismatch between the learning objectives and the evaluation process led to deceptive evaluations, which may have resulted in graduates being deemed ready to deploy despite facing hardships in real-world settings, potentially leading to unprepared responders. |
| format | Article |
| id | doaj-art-72b04b4be2b849aabc169bac466c28fa |
| institution | Kabale University |
| issn | 1472-6920 |
| language | English |
| publishDate | 2025-02-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medical Education |
| spelling | doaj-art-72b04b4be2b849aabc169bac466c28fa2025-02-09T12:42:46ZengBMCBMC Medical Education1472-69202025-02-0125111410.1186/s12909-025-06659-0Monitoring and evaluation in disaster management courses: a scoping reviewGeorge Teo Voicescu0Hamdi Lamine1Andra Elena Loșonți2Eugenia Maria Lupan-Mureșan3Sonia Luka4José García Ulerio5Luca Ragazzoni6Francesco Della Corte7Marta Caviglia8CRIMEDIM—Center for Research and Training in Disaster Medicine, Humanitarian Aid and Global Health, Università del Piemonte OrientaleCRIMEDIM—Center for Research and Training in Disaster Medicine, Humanitarian Aid and Global Health, Università del Piemonte OrientaleDepartment Paediatrics III, Emergency Clinic Hospital for ChildrenEmergency Medicine Discipline - Department 6 Surgery, “Iuliu Hatieganu” University of Medicine and PharmacyEmergency Medicine Discipline - Department 6 Surgery, “Iuliu Hatieganu” University of Medicine and PharmacyCRIMEDIM—Center for Research and Training in Disaster Medicine, Humanitarian Aid and Global Health, Università del Piemonte OrientaleCRIMEDIM—Center for Research and Training in Disaster Medicine, Humanitarian Aid and Global Health, Università del Piemonte OrientaleCRIMEDIM—Center for Research and Training in Disaster Medicine, Humanitarian Aid and Global Health, Università del Piemonte OrientaleCRIMEDIM—Center for Research and Training in Disaster Medicine, Humanitarian Aid and Global Health, Università del Piemonte OrientaleAbstract Background Owing to the infrequent emergence of disasters and the challenges associated with their management, responders need appropriate training beyond doubt. Ensuring the highest standard of disaster management (DM) training is of paramount importance for high-quality DM. However, the literature concerning DM training monitoring and evaluation (M&E) is scarce. The primary objective of this review was to document the existing M&E strategies for DM training. Methods The authors conducted a systematic literature search on June 28, 2023, on the PubMed, Scopus, Embase and Cochrane databases, including studies that described the learning objectives and the M&E strategy of DM training. The authors categorized the learning objectives and the evaluation methodology according to the revised Bloom’s Taxonomy and the New World Kirkpatrick model, respectively. Results Fifty-seven articles met the inclusion and exclusion criteria, described DM training targeting healthcare and non-healthcare professionals and employed diverse teaching methods and topics. Five studies reported using monitoring, while all reported an evaluation methodology. The learning objectives focused on students’ ability to “Remember” (N = 50) and “Apply”(N = 44). The evaluations centred around the second level of the New World Kirkpatrick model (N = 57), with only 7 articles investigating the third level. Sixteen authors used existing, validated M&E frameworks. When corelating the learning objectives with the evaluation methodology, the authors observed a mismatch, as skills like the students’ ability to “Apply” and “Create” were evaluated using the second level of the New World Kirkpatrick model. Conclusions The great heterogeneity in DM training highlights the particularity of these educational programs. The lack of monitoring and the low usage of existing M&E frameworks highlighted a lack of awareness and standardization in the field. The mismatch between the learning objectives and the evaluation process led to deceptive evaluations, which may have resulted in graduates being deemed ready to deploy despite facing hardships in real-world settings, potentially leading to unprepared responders.https://doi.org/10.1186/s12909-025-06659-0Capacity Building standardsEducational MeasurementDisaster Medicine educationDisaster PlanningMonitoring and EvaluationDisaster Management |
| spellingShingle | George Teo Voicescu Hamdi Lamine Andra Elena Loșonți Eugenia Maria Lupan-Mureșan Sonia Luka José García Ulerio Luca Ragazzoni Francesco Della Corte Marta Caviglia Monitoring and evaluation in disaster management courses: a scoping review BMC Medical Education Capacity Building standards Educational Measurement Disaster Medicine education Disaster Planning Monitoring and Evaluation Disaster Management |
| title | Monitoring and evaluation in disaster management courses: a scoping review |
| title_full | Monitoring and evaluation in disaster management courses: a scoping review |
| title_fullStr | Monitoring and evaluation in disaster management courses: a scoping review |
| title_full_unstemmed | Monitoring and evaluation in disaster management courses: a scoping review |
| title_short | Monitoring and evaluation in disaster management courses: a scoping review |
| title_sort | monitoring and evaluation in disaster management courses a scoping review |
| topic | Capacity Building standards Educational Measurement Disaster Medicine education Disaster Planning Monitoring and Evaluation Disaster Management |
| url | https://doi.org/10.1186/s12909-025-06659-0 |
| work_keys_str_mv | AT georgeteovoicescu monitoringandevaluationindisastermanagementcoursesascopingreview AT hamdilamine monitoringandevaluationindisastermanagementcoursesascopingreview AT andraelenalosonti monitoringandevaluationindisastermanagementcoursesascopingreview AT eugeniamarialupanmuresan monitoringandevaluationindisastermanagementcoursesascopingreview AT sonialuka monitoringandevaluationindisastermanagementcoursesascopingreview AT josegarciaulerio monitoringandevaluationindisastermanagementcoursesascopingreview AT lucaragazzoni monitoringandevaluationindisastermanagementcoursesascopingreview AT francescodellacorte monitoringandevaluationindisastermanagementcoursesascopingreview AT martacaviglia monitoringandevaluationindisastermanagementcoursesascopingreview |