Books or Laptops? The Cost-Effectiveness of Shifting from Printed to Digital Delivery of Educational Content in Honduras

Researchers:
Rosangela Bando
Dario Romero Fonseca
Fieldwork by:
Location:
Honduras
Sample:
271 schools with 9,600 students
Timeline:
2011 - 2014
Target group:
  • Students
Outcome of interest:
  • Student learning
Intervention type:
  • Digital and mobile
  • School-based inputs
Partners:

The impact of technology use in education is an increasingly salient topic around the world. Researchers partnered with the Honduran government, who introduced a school laptop program, to evaluate the impact of replacing textbooks with laptops on student learning. Using laptops resulted in no change in learning outcomes, suggesting that laptops could be a cost-effective substitute to textbooks if they can replace enough textbooks.

Policy issue

Over the past 20 years, the use of technology for education has increased in many regions of the world.1  This is especially true in Latin America and the Caribbean, where 31 countries had implemented information and communication technology policies in schools by 2012,2  and governments and private providers have distributed around 10 million laptops to public schools.3


Despite these increases in computer use, its relative impact on student learning compared to traditional methods remains unclear. On one hand, laptops may support traditional instruction by providing additional learning opportunities and computational tools, information storage, and communication opportunities. However, other studies suggest that using computers might decrease learning by distracting students4 or reducing student-teacher interactions.5

Context of the evaluation

Honduras is a low middle-income country.6  As of 2013, Hondurans received, on average, twelve years of schooling.7

The study took place among 271 Honduran public schools, with 9,600 students in third and fifth grade. Around 80 percent of schools were in rural communities, and all schools were in communities with a poverty rate of 58 percent or higher at the time of the study. On average, teachers had fifteen years of work experience, schools had 181 students, and classrooms had one teacher for every thirty students.

Students working together on a laptop.
Students use a laptop for in-class learning.

Details of the intervention

Researchers partnered with the Honduran Ministry of Education to conduct a randomized evaluation that tested the impact of laptops on student learning.

In 2013, the Honduran Government introduced the Educatracho program to improve the quality of education in elementary schools in low-income areas. The program provided an XO 1.75 laptop, developed by the non-profit group One Laptop per Child, with free software programs and mathematics and Spanish textbooks adapted for on-screen use. The laptops also contained basic interactive exercises that did not adapt to users' learning patterns.

Researchers randomly selected around half the schools to receive laptops and Internet access. These schools did not receive Spanish or mathematics textbooks. The other half of the schools received textbooks, but did not receive laptops.

Toward the beginning of the 2013 school year, which ran from February to November, the Ministry of Education delivered laptops to treatment schools and mathematics and Spanish textbooks to comparison schools. Researchers collected follow-up data that October.

They tested students’ mathematics and Spanish performance, verbal fluency, information processing speed and memory, and digital literacy. Researchers also used administrative records to collect program cost information.

Results and policy lessons

Laptops appeared to cause no change in student learning outcomes compared to textbooks. Furthermore, these findings suggest that laptops could be a cost-effective tool if they replace more textbooks.

Take-Up: The program more than doubled the share of students who used computers at school, from 43 percent in the comparison group to 98 percent in the treatment group.

Student Learning: Both laptops and books resulted in similar learning gains. At the end of the school year, both groups improved test scores by 0.46 standard deviations.

Digital Skills: The laptop program seemed to have an effect on digital-related skills. Researchers estimated the future wage gains provided by digital literacy to be worth US$35 per student in 2013.

Cost-Effectiveness: Researchers estimated the cost of laptops per child for one year  (including technical assistance, Internet, and school training) at US$95 in 2013. They calculated the benefit per child to be US$63, which included money saved from replacing two textbooks, as well as students’ future wage gains from computer skills. Thus, the net cost per student of the laptop program was US$32. However, if each laptop replaced three additional print books (five total) it would become cost-effective. Since student learning outcomes were comparable when using printed textbooks and laptops, and computers continue to become cheaper, laptops could serve as a cost-efficient learning tool.

1.
World Bank. 2016. “Digital Dividends.” World Development Report 2016. Washington, D.C.: The World Bank.
2.
UNESCO. 2012. “ICT in Education in Latin America and the Caribbean. A Regional Analysis of ECT Integration and E-Readiness.” Institute of Statistics, United Nations Educational, Scientific and Cultural Organization. Montreal, Canada. Accessed July 26, 2016. http://uis.unesco.org
3.
Arias Ortiz, Elena and Julian P. Cristia. 2014. “The IDB and Technology in Education: How to Promote Effective Programs?” Technical Note No. IDB-TN-670. Inter-American Development Bank. Washington, D.C. https://publications.iadb.org/en/handle/11319/6550?localeattribute=en
4.
Beuermann, Diether W., Julian Cristia, Santiago Cueto, Ofer Malamud, and Yyannu Cruz-Aguayo. 2015. "One Laptop per Child at Home: Short-Term Impacts from a Randomized Experiment in Peru." American Economic Journal: Applied Economics. 7(2): 53-80. DOI: 10.1257/app.20130267; Malamud, O., and C. Pop-Eleches. 2011. “Home Computer Use and the Development of Human Capital.” Quarterly Journal of Economics. 126: 987-1027.
5.
Banerjee, Abhijit and Esther Duflo. 2014. “(Dis)organization and success in an economics MOOC.” American Economic Review. 104(5): 514-518.
6.
The World Bank. 2016. “Honduras Overview.” Accessed October 20, 2016. http://www.worldbank.org/en/country/honduras/overview.
7.
CIA: Central Intelligence Agency. 2013. “The World Factbook.” Central Intelligence Agency of the United States of America. Accessed November 3, 2016.https://www.cia.gov/library/publications/download/download-2013/index.html.