Sustainability and Scalability of Digital Tools for Learning: ABRACADABRA in Kenya
Keywords:educational technology, sustainability factors, scaling, sub-saharan Africa
This paper explores factors to increase the likelihood that the implementation of ABRACADABRA, a technology-based approach to teaching and learning literacy, endures and expands beyond the initial research. Started as a pilot study in 12 classrooms, the implementation spread to more than 500 primary classrooms over six years in five areas of Kenya. Drawing from research about scalability and sustainability of educational interventions and value-expectancy-cost theory, an exploratory survey was designed to interview a range of actors involved in the software implementation. We used a combination of an a priori and data-driven coding approaches to analyse the narratives. We then built a model exploring the relationship between expectancy-value-cost beliefs and the factors associated with implementation and sustainability. The model explained an important portion of variance in the self-reported intent to use the software with the most significant contributions from policies, professional development, and students. These findings may be useful in the context of low- and medium-income countries where no research-proven principles exist to building sustainable and scalable educational interventions.
Abrami, P. C., Lysenko, L., & Borokhovski, E. (2020). The effects of ABRACADABRA on reading outcomes: An updated meta-analysis and landscape review of applied field research. Journal of Computer-Assisted Learning, 36, 260-279. https://doi.org/10.1111/jcal.12417
Abrami, P. C., Poulsen, C., & Chambers, B. (2004). Teacher motivation to implement an educational innovation: Factors differentiating users and non-users of cooperative learning. Educational Psychology, 24(2), 201-216. https://doi.org/10.1080/0144341032000160146
Abrami, P. C., Wade, A., Lysenko, L., Marsh, J., & Gioko, A. (2016). Using educational technology to develop early literacy skills in Sub-Saharan Africa. Education and Information Technologies. 19(4). http://dx.doi.org/10.1007/s10639-014-9362-4
Argyris, C. (1993). Knowledge for action: A guide to overcoming barriers to organizational change. Jossey-Bass. https://doi.org/10.1080/0144341032000160146
Bennell, P., & Akyeampong, K. (2007). Teacher motivation in sub-Saharan Africa and south Asia (No. 71). Department for International Development. https://assets.publishing.service.gov.uk/media/57a08be640f0b652dd000f9a/ResearchingtheIssuesNo71.pdf
Bold, T., Kimenyi, M., Mwabu, G., & Sandefur, J. (2018). Experimental evidence on scaling up education reforms in Kenya. Journal of Public Economics, 168, 1-20. https://doi.org/10.1016/j.jpubeco.2018.08.007
Century, J., Cassata, A., Rudnick, M., & Freeman, C. (2012). Measuring enactment of innovations and the factors that affect implementation and sustainability: Moving toward common language and shared conceptual understanding. Journal of Behavioral Health Services & Research, 39, 343-361. https://doi.org/10.1007/s11414-012-9287-x
Christensen, C. (1997). The innovator’s dilemma. Harvard University Press.
Coburn, C. E. (2003). Rethinking scale: Moving beyond numbers to deep and lasting change. Educational Researcher, 32(6), 3-12. https://doi.org/10.3102/0013189X032006003
Dede, C. (2006). Scaling up: Evolving innovations beyond ideal settings to challenging contexts of practice. In R. K. Sawyer (Ed.), Cambridge handbook of the learning sciences (pp. 551-566). Cambridge University Press. https://doi.org/10.1017/CBO9780511816833.034
Elmore, R. (1996). Getting to scale with good educational practice. Harvard Educational Review, 66(1), 1-27. https://doi.org/10.17763/haer.66.1.g73266758j348t33
Evans, D. K., & Popova, A. (2016). What really works to improve learning in developing countries? An analysis of divergent findings in systematic reviews. The World Bank Research Observer, 31(2), 242-270. https://doi.org/10.1093/wbro/lkw004
Fullan, M. (1982, February). Implementing educational change: Progress at last. [Paper presentation] (ED221540) Conference on the Implications of Research on Teaching for Practice, Washington, D.C., United States. https://files.eric.ed.gov/fulltext/ED221540.pdf
Goodson, I. (1989). Curriculum reform and curriculum theory: A case of historical amnesia. Cambridge Journal of Education, 19(2), 131-141. https://doi.org/10.1080/0305764890190203
Kim, Y. S. G., Lee, H., & Zuilkowski, S. S. (2020). Impact of literacy interventions on reading skills in low‐and middle-income countries: A meta-analysis. Child Development, 91(2), 638-660. https://doi.org/10.1111/cdev.13204
Lysenko, L., Abrami, P. C., Wade, A., Marsh, J., WaGioko, M., & Kiforo, E. (2019). Promoting young Kenyans’ growth in literacy with educational technology: A tale of two years of implementation. International Journal of Educational Research, 95, 176-189. https://doi.org/10.1016/j.ijer.2019.02.013
McLean, R., & Gargani, J. (2019). Scaling impact: Innovation for the public good. Routledge. https://doi.org/10.4324/9780429468025
Mingaine, L. (2013). Challenges in the implementation of ICT in public secondary schools in Kenya. Journal of Education and Learning, 2, 32-43. https://doi.org/10.5539/jel.v2n1p32
Mioduser, D., Nachmias, R., Forkosh, B. A., & Tubin, D. (2004). Sustainability, scalability and transferability of ICT-based pedagogical innovations in Israeli schools. Education, Communication & Information, 4(1), 71-82. https://doi.org/10.1080/1463631042000210999
Mishra, P., & Koehler, M. J. (2006). Technological pedagogical content knowledge: A new framework for teacher knowledge. Teachers College Record, 108, 1017-1054. https://doi.org/10.1111/j.1467-9620.2006.00684.x
Myers, R. (1984, October 29-31). Going to scale. United Nations Children’s Fund Inter-agency Meeting on Community-based Child development. [Paper Presentation] (ED273352). New York, NY, United States. https://files.eric.ed.gov/fulltext/ED273352.pdf
Omwenga, E., Nyabero, C., & Okioma, L. (2015). Assessing the influence of the PTTC principal’s competency in ICT on the teachers’ integration of ICT in teaching science in PTTCs in Nyanza region, Kenya. Journal of Education and Practice, 6(35), 142-148.
Piper, B., Destefano, J., Kinyanjui, E. M., & Ong’ ele, S. (2018). Scaling up successfully: Lessons from Kenya’s Tusome national literacy program. Journal of Educational Change, 19(3), 293-321. https://doi.org/10.1007/s10833-018-9325-4
Pouezevara, S., Mekhael, S. W., & Darcy, N. (2014). Planning and evaluating ICT in education programs using the four dimensions of sustainability: A program evaluation from Egypt. International Journal of Education and Development using Information and Communication Technology, 10(2), 120-141.
Robinson, J. P., Winthrop, R., & McGivney, E. J. (2016). Millions learning: Scaling up quality education in developing countries. Brookings Institute. https://www.brookings.edu/research/millions-learning-scaling-up-quality-education-in-developing-countries/
Rogers, E. (1962). Diffusion of Innovations. Free Press.
Salinas, Á., Nussbaum, M., Herrera, O., Solarte, M., & Aldunate, R. (2017). Factors affecting the adoption of information and communication technologies in teaching. Education and Information Technologies, 22(5), 2175-2196. https://doi.org/10.1007/s10639-016-9540-7
Shepperd, J. A. (1993). Productivity loss in performance groups: A motivation analysis. Psychological Bulletin, 113(1), 67. https://doi.org/10.1037/0033-2909.113.1.67
Wozney, L., Venkatesh, V., & Abrami, P. (2006). Implementing computer technologies: Teachers’ perceptions and practices. Journal of Technology and Teacher Education, 14(1), 173-207.
UNESCO. (2015). Education for sustainable development: Learning objectives. http://unesdoc.unesco.org/images/0024/002474/247444e.pdf
UNESCO. (2021a). Reimagining our futures together – A new social contract for education. Report from the International Commission on the futures of education, 2021. UNESCO. https://unesdoc.unesco.org/ark:/48223/pf0000379707.locale=en
UNESCO. (2021b). One year into COVID: Prioritizing education recovery to avoid a generational catastrophe. https://unesdoc.unesco.org/ark:/48223/pf0000376984
UNESCO Institute for Statistics (UIS). (2019a). Meeting commitments: Are countries on track to achieve SDG 4? Global education monitoring report. https://unesdoc.unesco.org/ark:/48223/pf0000369009
UNESCO Institute for Statistics (UIS). (2019b). Fact Sheet No. 56. New methodology shows that 258 million children, adolescents and youth are out of school. http://uis.unesco.org/sites/default/files/documents/new-methodology-shows-258-million-children-adolescents-and-youth-are-out-school.pdf
United Nations. (2000). United Nations Millennium Development Goals. https://www.un.org/millenniumgoals/
Copyright (c) 2022 Larysa Lysenko, Philip C. Abrami, C. Anne Wade
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under an International Creative Commons Attribution-NonCommercial License (CC-BY-NC 4.0) that allows others to share the work for non-commercial purposes, with an acknowledgement of the work's authorship and initial publication in this journal.