Implementación y formación del profesorado de educación primaria en pensamiento computacionaluna revisión sistemática

  1. Gema Ortuño Meseguer 1
  2. José Luis Serrano 1
  1. 1 Universidad de Murcia (España)
Revista:
RIED: revista iberoamericana de educación a distancia

ISSN: 1138-2783

Año de publicación: 2024

Título del ejemplar: Tendencias en la Educación Digital

Volumen: 27

Número: 1

Páginas: 255-287

Tipo: Artículo

DOI: 10.5944/RIED.27.1.37572 DIALNET GOOGLE SCHOLAR lock_openAcceso abierto editor

Otras publicaciones en: RIED: revista iberoamericana de educación a distancia

Objetivos de desarrollo sostenible

Resumen

El pensamiento computacional engloba procesos mentales que propician soluciones automatizadas a problemas específicos. Su integración en la educación primaria se sustenta en la mejora de habilidades resolutivas y adaptación al entorno digital. No obstante, la formación del profesorado y las estrategias eficaces para su implementación en aulas son aún ambiguas. Estas inquietudes se abordan en esta revisión sistemática, destacando la influencia de la práctica escolar en la configuración de planes de estudio de educación. Esta investigación examina la implementación del pensamiento computacional y la formación del profesorado en la etapa de educación primaria. Inicialmente, se identificaron 428 estudios en Scopus y Web Of Science, reduciéndose a 24 estudios empíricos publicados entre 2006 y 2023 tras aplicar los criterios de elegibilidad y la evaluación de calidad. Los resultados indican que muchos docentes intentan incorporar el pensamiento computacional sin suficiente formación. La programación de robots prevalece como estrategia principal y es la más demandada en la formación, mientras que el empleo de actividades desconectadas es limitado. No obstante, antes de promover el pensamiento computacional en primaria, se requiere mayor investigación, especialmente en los primeros cursos. Se insta a las Facultades de Educación a liderar el diseño y evaluación de programas de formación del profesorado, ofreciéndose pautas al respecto. La integración exitosa del pensamiento computacional en educación primaria demanda enfoques pedagógicos más sólidos respaldados por una formación docente adecuada

Referencias bibliográficas

  • Alves, N. D. C., Von Wangenheim, C. G., & Hauck, J. C. (2019). Approaches to Assess Computational Thinking Competences Based on Code Analysis in K-12 Education: A Systematic Mapping Study. Informatics in Education, 18(1), 17-39. https://doi.org/10.15388/infedu.2019.02
  • Angeli, C., Voogt, J., Fluck, A., Webb, M., Cox, M., Malyn-Smith, J., & Zagami, J. (2016). A K-6 Computational Thinking Curriculum Framework: Implications for Teacher Knowledge. Educational Technology and Society (EtandS), 19(3), 47-57. https://www.j-ets.net/collection/published-issues/19_3
  • Arranz, H., & Pérez, A. (2017). Evaluación del Pensamiento Computacional en Educación. Revista Interuniversitaria de Investigación en Tecnología Educativa (RIITE), (3), 25-39. https://doi.org/10.6018/riite/2017/267411
  • Barcelos, T. S., Munoz, R., Villarroel, R., Merino, E., & Silveira, I. F. (2018). Mathematics Learning through Computational Thinking Activities: A Systematic Literature Review. Journal of Universal Computer Science, 24(7), 815-845. https://doi.org/10.3217/jucs-024-07-0815
  • Basu, S., Rutstein, D. W., Xu, Y., Wang, H., & Shear, L. (2021). A principled approach to designing computational thinking concepts and practices assessments for upper elementary grades. Computer Science Education, 31(2), 169-198. https://doi.org/10.1080/08993408.2020.1866939
  • Bocconi, S., Chioccariello, A., Dettori, G., Ferrari, A., Engelhardt, K., Kampylis, P., & Punie, Y. (2016). Exploring the field of computational thinking as a 21st century skill. EDULEARN 16, Barcelona, España. https://doi.org/10.21125/edulearn.2016.2136
  • Brackmann, C. P., Román-González, M., Robles, G., Moreno-León, J., Casali, A., & Barone, D. (2017). Development of Computational Thinking Skills through Unplugged Activities in Primary School [Acta]. 12th Workshop on Primary and Secondary Computing Education (WiPSCE), Nijmegen, Países Bajos. https://doi.org/10.1145/3137065.3137069
  • Bustillo, J. (2015). Formación del profesorado con Scratch: análisis de la escasa incidencia en el aula. Opción, 31(1), 164-182. http://www.redalyc.org/articulo.oa?id=31043005010
  • Butler, D., & Leahy, M. (2021). Developing preservice teachers’ understanding of computational thinking: A constructionist approach. British Journal of Educational Technology, 52(3), 1060-1077. https://doi.org/10.1111/bjet.13090
  • Caballero-González, Y., & García-Valcárcel, A. (2020). ¿Aprender con robótica en Educación Primaria? Un medio de estimular el pensamiento computacional. Education in the Knowledge Society, 21, 10. https://doi.org/10.14201/eks.21443
  • Carlborg, N., Tyrén, M., Heath, C., & Eriksson, E. (2019). The scope of autonomy when teaching computational thinking in primary school. International Journal of Child-Computer Interaction, 21, 130-139. https://doi.org/10.1016/j.ijcci.2019.06.005
  • Chalmers, C. (2018). Robotics and computational thinking in primary school. International Journal of Child-Computer Interaction, 17, 93-100. https://doi.org/10.1016/j.ijcci.2018.06.005
  • Chan, S.-W., Looi, C.-K., Ho, W. K., & Kim, M. S. (2023). Tools and Approaches for Integrating Computational Thinking and Mathematics: A Scoping Review of Current Empirical Studies. Journal of Educational Computing Research, 60(8), 2036-2080. https://doi.org/10.1177/07356331221098793
  • Chevalier, M., Giang, C., Piatti, A., & Mondada, F. (2020). Fostering computational thinking through educational robotics: a model for creative computational problem solving. International Journal of STEM Education, 7, 39. https://doi.org/10.1186/s40594-020-00238-z
  • Chiazzese, G., Arrigo, M., Chifari, A., Lonati, V., & Tosto, C. (2019). Educational Robotics in Primary School: Measuring the Development of computational Thinking Skills with the Bebras Tasks. Informatics, 6(4), 6040043. https://doi.org/10.3390/informatics6040043
  • Cometa, V., Parque, S., & Wiebe, E. (2021). The code-centric nature of computational thinking education: a review of trends and issues in computational thinking education research. Sage, 11(2). https://doi.org/10.1177/21582440211016418
  • Cutumisu, M., Adams, C., & Lu, C. (2019). A Scoping Review of Empirical Research on Recent Computational Thinking Assessments. Journal of Science Education and Technology, 28(1), 651-676. https://doi.org/10.1007/s10956-019-09799-3
  • Del Olmo, J. del, Cózar-Gutiérrez, R., & González-Calero, J. A. (2020). Computational thinking through unplugged activities in early years of Primary Education. Computers & Education, 150(1), 103832. https://doi.org/10.1016/j.compedu.2020.103832
  • El-Hamamsy, L., Zapata-Cáceres, M., Martín-Barroso, E., Mondada, F., Dehler-Zufferey, J., & Bruno, B. (2022). The Competent Computational Thinking Test: Development and Validation of an Unplugged Computational Thinking Test for Upper Primary School. Sage, 60(7), 1818-1866. https://doi.org/10.1177/07356331221081753
  • Esteve-Mon, F., Adell-Segura, J., Llopis, M. A., Valdeoliva, G., & Pacheco, J. (2019). The Development of Computational Thinking in Student Teachers through an Intervention with Educational Robotics. Journal of Information Technology Education: Innovations in Practice, 18, 139-152. https://doi.org/10.28945/4442
  • Freina, L., Bottino, R., & Ferlino, L. (2019). Fostering Computational Thinking skills in the Last Years of Primary School. International Journal of Serious Games, 6(3), 101-115. https://doi.org/10.17083/ijsg.v6i3.304
  • García-Tudela, P. A., & Marín-Marín, J. A. (2023). Use of Arduino in Primary Education: a systematic review. Education Sciences, 13(2), 134. https://doi.org/10.3390/educsci13020134
  • González, J., Estebanell, M., & Peracaula, M. (2018). ¿Robots o programación? El concepto de Pensamiento Computacional y los futuros maestros. Education in the Knowledge Society (EKS), 19(2), 29-45. https://doi.org/10.14201/eks20181922945
  • Haseski, H. I. e Ilic, U. (2019). An Investigation of the Data Collection Instruments Development to Measure Computational Thinking. Informatics in Education, 18(2), 297-319. https://doi.org/10.15388/infedu.2019.14
  • Hooshyar, D., Malva, L., Yang, Y., Pedaste, M., Wang, M., & Lim, H. (2021). An adaptive educational computer game: Effects on students' knowledge and learning attitude in computational thinking. Computers in Human Behavior, 114, 106575. https://doi.org/10.1016/j.chb.2020.106575
  • Hsu, Y.-C., Irie, N. R., & Ching, Y.-H. (2019). Computational Thinking Educational Policy Initiatives (CTEPI) Across the Globe. TechTrends, 63(2), 260-270. https://doi.org/10.1007/s11528-019-00384-4
  • Huang, S.-Y., Tarng, W., & Ou, K.-L. (2023). Effectiveness of AR Board Game on Computational Thinking and Programming Skills for Elementary School Students. Systems, 11(1), 25. https://doi.org/10.3390/systems11010025
  • Huang, W., & Looi, C.-K. (2020). A critical review of literature on "unplugged" pedagogies in K-12 computer science and computational thinking education. Computer Science Education, 31(1), 83-111. https://doi.org/10.1080/08993408.2020.1789411
  • Ioannou, A., & Makridou, E. (2018). Exploring the potentials of educational robotics in the development of computational thinking: A summary of current research and practical proposal for future work. Education and Information Technologies, 23(1), 2531-2544. https://doi.org/10.1007/s10639-018-9729-z
  • Jaipal-Jamani, K., & Angeli, C. (2016). Effect of Robotics on Elementary Preservice Teachers´ Self-Efficacy, Science Learning and Computational Thinking. Journal of Science Education and Technology, 26(2), 175-192. https://doi.org/10.1007/s10956-016-9663-z
  • Jiang, B., & Li, Z. (2021). Effect of Scratch on computational thinking skills of Chinese primary school students. Journal of Computers in Education, 8(4), 505-525. https://doi.org/10.1007/s40692-021-00190-z
  • Kale, U., Akcaoglu, M., Cullen, T., Goh, D., Devine, L., Calvert, N., & Grise, K. (2018). Computational What? Relating Computational Thinking to Teaching. TechTrends, 62(6), 574-584. https://doi.org/10.1007/s11528-018-0290-9
  • Kalelioğlu, F., Gülbahar, Y., & Kukul, V. (2016). A Framework for Computational Thinking Based on a Systematic Research Review. Baltic Journal Modern Computing, 4(3), 583-596. https://www.bjmc.lu.lv/fileadmin/user_upload/lu_portal/projekti/bjmc/Contents/4_3_15_Kalelioglu.pdf
  • Ketelhut, D.-J., Mills, K., Hestness, E., Cabrera, L., Plane, J., & McGinnis, J.-R. (2019). Teacher Change Following a Professional Development Experience in Integrating Computational Thinking into Elementary Science. Journal of Science Education and Technology, 29(1), 174-188. https://doi.org/10.1007/s10956-019-09798-4
  • Kitchenham, B., & Charters, S. (2007). Guidelines for performing Systematic Literature Reviews in Software Engineering. Version 2.3. In EBSE Technical Report EBSE-2007-01. https://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.117.471
  • Kong, S.-C., & Lai, M. (2022). A proposed computational thinking teacher development framework for K-12 guided by the TPACK model. Journal of Computers in Education, 9, 379-402. https://doi.org/10.1007/s40692-021-00207-7
  • Kong, S.-C., Lai, M., & Li, Y. (2023). Scaling up a teacher development programme for sustainable computational thinking education: TPACK surveys, concept tests and primary school visits. Computers & Education, 194, 104707. https://doi.org/10.1016/j.compedu.2022.104707
  • Kong, S.-C., Lai, M., & Sun, D. (2020). Teacher development in computational thinking: Design and learning outcomes of programming concepts, practices and pedagogy. Computers & Education, 151, 103872. https://doi.org/10.1016/j.compedu.2020.103872
  • Korkmaz, Ö., Çakir, R., & Özden, M. Y. (2017). A validity and reliability study of the Computational Thinking Scales (CTS). Computers in Human Behavior, 72, 558-569. https://doi.org/10.1016/j.chb.2017.01.005
  • Kotsopoulos, D., Floyd, L, Khan, S., Namukasa, I., Somanath, S., Weber, J., & Chris, Y. (2017). A Pedagogical Framework for Computational Thinking. Digital Experiences in Mathematics Education, 3(2), 154-171. https://doi.org/10.1007/s40751-017-0031-2
  • Li, F., Wang, X., He, X., Cheng, L., & Wang, Y. (2022). The effectiveness of unplugged activities and programming exercises in computational thinking education: A Meta-analysis. Education and Information Technologies, 27, 7993-8013. https://doi.org/10.1007/s10639-022-10915-x
  • Ling, U. L., Saibin, T. C., Labadin, J., & Aziz, N. A. (2018). Preliminary Investigation: Teachers´ Perception on Computational Thinking Concepts. Journal of Telecommunication, Electronic and Computer Engineering, 9(2-9), 23-29. https://jtec.utem.edu.my/jtec/article/view/2672
  • Liu, X., Wang, X., Xu, K., & Hu, X. (2023). Effect of Reverse Engineering Pedagogy on Primary School Students’ Computational Thinking Skills in STEM Learning Activities. Journal of Intelligence, 11(2), 36. https://doi.org/10.3390/jintelligence11020036
  • Lockwood, J., & Mooney, A. (2017). Computational Thinking in Education: Where does it fit? A systematic literacy review. https://doi.org/10.48550/arXiv.1703.07659
  • Lye, S. Y., & Koh, J. H. L. (2014). Review on teaching and learning and learning of computational thinking through programming: What is next for K-12? Computers in Human Behavior, 41, 51-61. https://doi.org/10.1016/j.chb.2014.09.012
  • Menon, D., Romero, M., & Viéville, T. (2019). Computational thinking development and assessment through tabletop escape games. International Journal of Serious Games, 6(4), 3-18. https://doi.org/10.17083/ijsg.v6i4.319
  • Merino-Armero, J. M., González-Calero, J. A., & Cózar-Gutiérrez, R. (2021). Computational thinking in K-12 education. An insight through meta-analysis. Journal of Research on Technology in Education, 54(3), 1-26. https://doi.org/10.1080/15391523.2020.1870250
  • Mishra, P., & Koehler, M. J. (2006). Technological pedagogical content knowledge: A framework for integrating technology in teacher knowledge. Teachers College Record, 108(6), 1017-1054. https://doi.org/10.1111/j.1467-9620.2006.00684.x
  • Molina-Ayuso, A., Adamuz, N., López, R. B., & Torralbo, M. (2022). Introduction to Computational Thinking with Scratch for Teacher Training for Spanish Primary School Teachers in Mathematics. Education Sciences, 12(12), 899. https://doi.org/10.3390/educsci12120899
  • Moreno-León, J., Robles, G., Román-González, M., & Rodríguez, J. D. (2019). No es lo mismo: un análisis de red de texto sobre definiciones de pensamiento computacional para estudiar su relación con la programación informática. Revista Interuniversitaria de Investigación en Tecnología Educativa (RIITE), (7), 26-35. https://doi.org/10.6018/riite.397151
  • Moreno-León, J., Robles, G., & Román-González, M. (2015). Dr. Scratch: Análisis Automático de Proyectos Scratch para Evaluar y Fomentar el Pensamiento Computacional. Revista de Educación a Distancia (RED), 46(10). https://doi.org/10.6018/red/46/10
  • Noh, J., & Lee, J. (2019). Effects of robotics programming on the computational thinking and creativity of elementary school students. Education Technology Research and Development, 68(1), 463-484. https://doi.org/10.1007/s11423-019-09708-w
  • Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanvill, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., Mcdonald, S., McGuinness, L. A., Stewart, L. A., Thomas, J., Tricco, A. C., …, & Moher, D. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Bmj, 372, 71. https://doi.org/10.1136/bmj.n71
  • Palts, T., & Pedaste, M. (2020). A Model for Developing Computational Thinking Skills. Informatics in Education, 19(1), 113-128. https://doi.org/10.15388/infedu.2020.06
  • Park, Y.-S., & Park, M. (2018). Exploring Students Competencies to be Creative Problem Solvers With Computational Thinking Practices. Journal of the Korean Earth Science Society, 39(4), 388-400. https://doi.org/10.5467/JKESS.2018.39.4.388
  • Pollak, M., & Ebner, M. (2019). The Missing Link to Computational Thinking. Future Internet, 11(12), 263. https://doi.org/10.3390/fi11120263
  • Popat, S., & Starkey, L. (2018). Learning to code or coding to learn? A systematic review. Computers & Education, 128, 365-376. https://doi.org/10.1016/j.compedu.2018.10.005
  • Rich, P., Mason, S., & O´Leary, J. (2021). Measuring the effect of continuous professional development on elementary teachers’ self-efficacy to teach coding and computational thinking. Computers & Education, 168(3), 104196. https://doi.org/10.1016/j.compedu.2021.104196
  • Rich, P., & Langton, M. B. (2016). Computational Thinking: Toward a Unifying Definition. In J. M. Spector, D. Ifenthaler, D. G. Sampson, & P. Isaias (Eds.), Competencies in Teaching, Learning and Educational Leadership in the Digital Age (pp. 229-242). Springer. https://doi.org/10.1007/978-3-319-30295-9_14
  • Román-González, M., Moreno-León, J., & Robles, G. (13-15 de julio de 2017). Complementary Tools for Computational Thinking Assessment. International Conference on Computational Thinking Education 2017. Hong-Kong, China. https://www.researchgate.net/publication/318469859_Complementary_Tools_for_Computational_Thinking_Assessment
  • Román-González, M., Pérez-González, J. C., & Jiménez-Fernández, C. (18-20 de octubre de 2015). Test de Pensamiento Computacional: diseño y psicometría general. III Congreso Internacional sobre Aprendizaje, Innovación y Competitividad (CINAIC 2015). Madrid, España. https://doi.org/10.13140/RG.2.1.3056.5521
  • Sáez, J. M., & Cózar, R. (2017). Pensamiento computacional y programación visual por bloques en el aula de Primaria. Educar, 53(1), 129-146. https://doi.org/10.5565/rev/educar.841
  • Sánchez-Meca, J. (2022). Revisiones sistemáticas y meta-análisis en Educación: Un tutorial. Revista Interuniversitaria de Investigación en Tecnología Educativa (RIITE), 13, 5-40. https://doi.org/10.6018/riite.545451
  • Segredo, E., Miranda, G., & León, C. (2017). Hacia la educación del futuro: El pensamiento computacional como mecanismo de aprendizaje generativo. Education in the Knowledge Society (EKS), 18(2), 33-58. https://doi.org/10.14201/eks2017182335
  • Sengupta, P., Kinnebrew, J. S., Basu, S., Biswas, G., & Clark, D. (2013). Integrating computational thinking with K-12 science education using agent-based computation: A theoretical framework. Education and Information Technologies, 18(2), 351-380. https://doi.org/10.1007/s10639-012-9240-x
  • Serrano, J. L., & Ortuño, G. (2021). Percepciones del profesorado en formación sobre el desarrollo del pensamiento computacional desde el Modelo 5PC. EDUTEC. Revista Electrónica de Tecnología Educativa, (78), 212-230. https://doi.org/10.21556/edutec.2021.78.2173
  • Shen, J., Chen, G., Barth-Cohen, L., Jiang, S., & Eltoukhy, M. (2020). Connecting computational thinking in everyday reasoning and programming for elementary school students. Journal of Research on Technology in Education, 54(2), 205-225. https://doi.org/10.1080/15391523.2020.1834474
  • Shute, V. J., Sun, C., & Asbell-Clarke, J. (2017). Demystifying computational thinking. Educational Research Review, 22(1), 142-158. https://doi.org/10.1016/j.edurev.2017.09.003
  • Sun, L., Hu, L., & Zhou, D. (2021). Which way of design programming activities is more effective to promote K‐12 students’ computational thinking skills? A meta-analysis. Journal of Computer Assisted Learning, 37(4), 1048-1062. https://doi.org/10.1111/jcal.12545
  • Tang, X., Yin, Y., Lin, Q., Hadad, R., & Zhai, X. (2020). Assessing computational thinking: A systematic review of empirical studies. Computers & Education, 148(1), 103798. https://doi.org/10.1016/j.compedu.2019.103798
  • Tran, Y. (2019). Computational Thinking Equity in Elementary Classrooms: What Third-Grade Students Know and Can Do. Journal of Educational Computing, 57(1), 3-31. https://doi.org/10.1177/0735633117743918
  • Tsai, M., Liang, J., Lee, S., & Hsu, C. (2021). Structural Validación for the Development Model of Computational Thinking. Journal of Educational Computing Research, 60(1), 56-73. https://doi.org/10.1177/07356331211017794
  • Uslu, N. A., Yavuz, G. O., & Usluel, Y. K. (2022). A systematic review study on educational robotics and robots. Interactive Learning Environments, 1-25. https://doi.org/10.1080/10494820.2021.2023890
  • Voogt, J., Fisser, P., Good, J., Mishra, P., & Yadav, A. (2015). Computational thinking in compulsory education: Towards an agenda for research and practice. Education and Information Technologies, 20(4), 715-728. https://doi.org/10.1007/s10639-015-9412-6
  • Voon, X., Wong, S., Wong, L, Khambari, M., & Syed-Abdullah, S. (2023). Developing pre-service teachers’ computational thinking through experiential learning: hybridization of plugged and unplugged approaches. Research and Practice in Technology Enhanced Learning, 18(6), 1-27. https://doi.org/10.58459/rptel.2023.18006
  • Wei, X., Lin, L., Meng, N., Tan, W., Kong, S.-C., & Kinshuk. (2021). The effectiveness of partial pair programming on elementary school students’ Computational Thinking skills and self-efficacy. Computers & Education, 160, 104023. https://doi.org/10.1016/j.compedu.2020.104023
  • Weigend, M., Vaníček, J., Pluhár, Z., & Pesek, I. (2019). Computational Thinking Education through Creative Unplugged Activities. International Olympiads in Informatics Journal (IOI), 13, 171-192. https://doi.org/10.15388/ioi.2019.11
  • Wing, J. M. (2006). Computational thinking. Communications of the ACM, 49(3), 33-35. https://doi.org/10.1145/1118178.1118215
  • Xia, L., & Zhong, B. (2018). A systematic review on teaching and learning robotics content knowledge in K-12. Computers & Education, 127, 267-282. https://doi.org/10.1016/j.compedu.2018.09.007
  • Yadav, A., & Chakraborty, P. (2023). Introducing schoolchildren to computational thinking using smartphone apps: A way to encourage enrolment in engineering education. Computer Applications in Engineering Education, 1-19. https://doi.org/10.1002/cae.22609
  • Yadav, A., Gretter, S., Good, J., & McLean, T. (2017). Computational Thinking in Teacher Education en P. Rich and C.B. Hodges (Eds.), Emerging Research, Practice, and Policy on Computational Thinking (pp. 205-220). Springer. https://doi.org/10.1007/978-3-319-52691-1_13
  • Yadav, A., Krist, C., Good, J., & Caeli, E. N. (2018). Computational thinking in elementary classrooms: Measuring teacher understanding of computational ideas for teaching science. Computer Science Education, 28(4), 371-400. https://doi.org/10.1080/08993408.2018.1560550
  • Yadav, A., Mayfield, C., Zhou, N., Hambrusch, S., & Korb, J. T. (2014). Computational Thinking in Elementary and Secondary Teacher Education. ACM Transactions on Computing Education, 14(1), 1-16. https://doi.org/10.1145/2576872
  • Zapata-Ros, M. (2015). Pensamiento computacional: Una nueva alfabetización digital. Revista de Educación a Distancia (RED), 46(4), 1-47. https://doi.org/10.6018/red/46/4
  • Zhang, L., & Nouri, J. (2019). A systematic review of learning by computational thinking through Scratch in K-9. Computers & Education, 141, 103607. https://doi.org/10.1016/j.compedu.2019.103607