Systematic review of the characteristics of curricular evaluation in undergraduate academic programs through the PRISMA-NMA method
DOI:
https://doi.org/10.22458/caes.v13i2.4415Keywords:
Evaluation, Models, Curriculum Evaluation, Institutional Evaluation, Program EvaluationAbstract
Curricular evaluation practices in higher education are essential, given the self-evaluation and self-regulation processes required by the secretariats and ministries of education in each country. Therefore, this study aims to identify the characteristics of curricular evaluation practices in higher education programs, through a documentary analysis that incorporates the flowchart of the PRISMA-NMA method. The results obtained show that most of the studies did not have curricular evaluation models but were based on the development of methodologies based on qualitative and quantitative paradigms, in the same way, the characteristics and necessary elements were identified for the development of a curricular evaluation process.
References
Al-Htaybat, K., von Alberti-Alhtaybat, L., & Alhatabat, Z. (2018). Educating digital natives for the future: accounting educators’ evaluation of the accounting curriculum. Accounting Education, 27(4), 333–357. https://doi.org/10.1080/09639284.2018.1437758
Al-Jardani, K. S., Siraj, S., & Abedalaziz, N. (2012). Developing a framework for curriculum evalution in Oman. English Linguistics Research, 1(2), 1-6.
Andrian, D., Kartowagiran, B., & Hadi, S. (2018). The instrument development to evaluate local curriculum in Indonesia. International Journal of Instruction, 11(4), 921-934.
Arafeh, S. (2016). Curriculum mapping in higher education: a case study and proposed content scope and sequence mapping tool. Journal of Further and Higher Education, 40(5), 585-611. https://doi.org/10.1080/0309877X.2014.1000278
Aslan, M., & Saglam, M. (2017). Methodological investigation of the curriculum evaluation theses completed between the Years 2006-2015 in Turkey. Universal Journal of Educational Research, 5(9), 1468-1478.
Aydin, B., Unver, M. M., Alan, B., & Saglam, S. (2017). Combining the old and the new: designing a curriculum based on the taba model and the global scale of English. Journal of Language and Linguistic Studies, 13(1), 304-320.
Aygören, F., & Er, K. O. (2019). New approach at evaluating the private schools’ curriculum: I-CODE Model. Turkish Online Journal of Educational Technology-TOJET, 18(2), 58-81.
Begoña, M., Maximiliano, M., Cuellar, J., Domancic, S., & Villanueva, J. (2018). Revisiones sistemáticas: definición y nociones básicas. Revista Clínica Periodoncia e Implantología, 11(3), 184-186. https://doi.org/10.406/S0719-01072018000300184
Berger, E. R., Kreutzer, L., Halverson, A., Yang, A. D., Reinhart, S., Leary, K. J. O., Williams, M. V., Bilimoria, K. Y., & Johnson, J. K. (2020). Evaluation of Changes in Quality Improvement Knowledge Following a Formal Educational Curriculum Within a Statewide Learning Collaborative. Journal of Surgical Education, 77(6), 1534-1541. https://doi.org/10.1016/j.jsurg.2020.04.018
Bonilla-Calero, A. I., Carabantes-Alarcón, D., & Sastre-Castillo, M. Á. (2020). International Accreditation in Medical Education through WFME. Educación Médica, 20. https://doi.org/10.1016/j.edumed.2020.06.006
Bridgman, C., Suszko, A., Russell, D., Sampson, K. A., Moltchanova, E., & Robertson, I. (2017). A Roadmap for the Evaluation of Attributes in University Graduates. New Zealand Journal of Educational Studies, 53(1), 119-134. https://doi.org/10.1007/s40841-017-0102-3
Casanova, M. A. (2012). El diseño curricular como factor de calidad educativa. REICE. Revista Iberoamericana Sobre Calidad, Eficacia y Cambio En Educación, 10(4), 6-20. https://doi.org/10.14718/RevArq.2013.15.1.9
Castañeda, L., & Prendes, P. (2013). A curriculum development route map for a technology enhanced learning era. Universal Journal of Educational Research, 1(3), 209-220.
Dawson, S., & Hubball, H. (2014). Curriculum analytics: application of social network analysis for improving strategic curriculum decision-making in a research-intensive university. Teaching & Learning Inquiry, 2(2), 59-74.
García-Padilla, F. M., Sosa-Cordobés, E., Travé-González, G. H., & Simôes-Figueiredo, A. (2019). Innovation and research on the Community Nursing curriculum: Literature review. Educacion Medica, 20(2), 105-117. https://doi.org/10.1016/j.edumed.2018.07.002
Goldman, E. F., & Mintz, M. L. (2017). Using Concepts from Complexity Science to Accelerate Curricular Revision. Innovative Higher Education, 42(5-6), 437-449. https://doi.org/10.1007/s10755-017-9396-9
Gottipati, S., & Shankararaman, V. (2018). Competency analytics tool: Analyzing curriculum using course competencies. Education and Information Technologies, 23(1), 41-60. https://doi.org/10.1007/s10639-017-9584-3
Hadi, S., Andrian, D., & Kartowagiran, B. (2019). Evaluation model for evaluating vocational skills programs on local content curriculum in Indonesia: Impact of educational system in Indonesia. Eurasian Journal of Educational Research, 2019(82), 45-62. https://doi.org/10.14689/ejer.2019.82.3
Hutton, B., Catalá-López, F., & Moher, D. (2016). La extensión de la declaración PRISMA para revisiones sistemáticas que incorporan metaanálisis en red: PRISMA-NMA. Medicina Clínica, 20, 10-14. https://doi.org/10.1016/j.medcli.2016.02.025
Jones, A. C., Shipman, S. A., & Ogrinc, G. (2015). Key characteristics of successful quality improvement curricula in physician education: A realist review. BMJ Quality and Safety, 24(1), 77-88. https://doi.org/10.1136/bmjqs-2014-002846
Kavgaoglu, D., & Alci, B. (2016). Application of context input process and product model in curriculum evaluation: case study of a call centre. Educational Research and Reviews, 11(17), 1659-1669.
Kelly, S., & Abruzzo, E. (2020). Using Lesson-Specific Teacher Reports of Student Engagement to Investigate Innovations in Curriculum and Instruction. Educational Researcher. https://doi.org/10.3102/0013189X20982255
Khanna, P., Roberts, C., & Lane, A. S. (2021). Designing health professional education curricula using systems thinking perspectives. BMC Medical Education, 21(1). https://doi.org/10.1186/s12909-020-02442-5
Liao, H., & Li, L. (2017). A Mixed Methods Evaluation of College English Writing: A Case Study in China. Asia-Pacific Education Researcher, 26(6), 383-396. https://doi.org/10.1007/s40299-017-0357-y
Lippe, M., & Carter, P. (2018). Using the CIPP Model to Assess Nursing Education Program Quality and Merit. Teaching and Learning in Nursing, 13(1), 9-13. https://doi.org/10.1016/j.teln.2017.09.008
Loushine, T. W., & Feyen, R. G. (2013). Using professional certification criteria to assess occupational safety curricula in degree programs investigating accreditation. Higher Learning Research Communications, 3(2), 32-52.
Madaus, G., & Kellaghan, T. (2002). Models, metaphors, and definitions in evaluation. En D. L. Stufflebeam, G. F. Madaus, & T. Kellaghan (Eds.), Evaluation Models, 49, pp. 19-41. Kluwer Academic Publishers. https://doi.org/10.1007/0-306-47559-6
Mcdavid, J. C., & Huse, I. (2015). How does accreditation fit into the picture? New Directions for Evaluation, 2015(145), 53-69. https://doi.org/10.1002/ev.20111
Méndez, G., Ochoa, X., Chiluiza, K., & de Wever, B. (2014). Curricular design analysis: A data-driven perspective. Journal of Learning Analytics, 1(3), 84-119.
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009). Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Journal of Clinical Epidemiology, 62(10), 1006-1012. https://doi.org/10.1016/j.jclinepi.2009.06.005
Morbitzer, K. A., McLaughlin, J. E., Ozawa, S., Beechinor, R., Dumond, J., Pomykal, C., Bush, A., Zhang, Q., Carpenter, D., & Lee, C. R. (2021). Implementation and initial evaluation of a research and scholarship training pathway in a doctor of pharmacy curriculum. American Journal of Pharmaceutical Education, 85(1), 55-66. https://doi.org/10.5688/ajpe8079
Pigott, T. D., & Polanin, J. R. (2020). Methodological Guidance Paper: High-Quality Meta-Analysis in a Systematic Review. Review of Educational Research, 90(1), 24-46. https://doi.org/10.3102/0034654319877153
Prendes, M. P., Castañeda, L., & Gutiérrez, I. (2010). ICT competences of future teachers. Comunicar, 17(35), 175-181. https://doi.org/10.3916/C35-2010-03-11
Raycroft, M. A. R., & Flynn, A. B. (2020). What works? What’s missing? An evaluation model for science curricula that analyses learning outcomes through five lenses. Chemistry Education Research and Practice, 21(4), 1110-1131. https://doi.org/10.1039/c9rp00157c
Ross, S. J., Sen Gupta, T., & Johnson, P. (2021). Leadership curricula and assessment in Australian and New Zealand medical schools. BMC Medical Education, 21(1). https://doi.org/10.1186/s12909-020-02456-z
Sawaya, R. D., Mrad, S., Rajha, E., Saleh, R., & Rice, J. (2021). Simulation-based curriculum development: lessons learnt in Global Health education. BMC Medical Education, 21(1). https://doi.org/10.1186/s12909-020-02430-9
Scriven, M. (2002). Evaluation Ideologies. In D. L. Stufflebeam, G. F. Madaus, & T. Kellaghan (Eds.), Evaluation Models, (49), pp. 248-278. Kluwer Academic Publishers. https://doi.org/10.1007/0-306-47559-6
Sinaga, A. M., Nie, C., Leung, H., Lou, Y., Ghanbari, A., Li, X., Zhang, L. L., Hao, D., Zhang, L. L., Singh, Y., Kaur, A., Suri, B., Singhal, S., Wang, X. Z., He, Y. C. Y. P., Fraser, G., Zeller, A., Spieker, H., Gotlieb, A., … Woo, M. (2019). Evaluación del aprendizaje en la educación a distancia en línea. IEEE Transactions on Software Engineering, 24(4), 233-244. https://doi.org/10.1145/1390630.1390641
Stake, R. (2002). Program Evaluation, Particularly Responsive Evaluation. In D. L. Stufflebeam, G. F. Madaus, & T. Kellaghan (Eds.), Evaluation Models, (49), pp. 343-363. Kluwer Academic Publishers. https://doi.org/10.1007/0-306-47559-6
Strauss, & Corbin. (2002). Bases de la investigación cualitativa: Técnicas y procedimientos para desarrollar la teoría fundamentada. Editorial Universidad de Antioquia. http://www.academia.edu/download/38537364/Teoria_Fundamentada.pdf
Stufflebeam, D. (2016). Factors that influenced my conduct of evaluations and evaluation training programs. In Seven north american evaluation pioneers (Issue 150, pp. 13-15). American Evaluation Association. https://doi.org/10.1002/ev
Suyanti, I. (2019). The evaluation of curriculum 2013 implementation of class i and iv at sd Kecamatan air Kumbang. International Journal of Scientific and Technology Research, 8(4), 293-299.
Tyler, R. W. (2000). A rationale for program evaluation. In Evaluation in Education and Human Services (pp. 85–120). Kluwer Academic Publishers.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Revista Electrónica Calidad en la Educación Superior
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Esta revista provee acceso libre inmediato a su contenido bajo el principio de que hacer disponible gratuitamente la investigación al publico, lo cual fomenta un mayor intercambio de conocimiento global.