Closing the Early Learning Gap for Roma Children in Bulgaria
- Earnings and income
- Student learning
Inequalities in education start early in life, especially for children from low-income families, who often lack access to quality early childhood development opportunities such as kindergarten. Kindergarten education can lay the foundation for a child’s success in primary school and later in life by providing critical cognitive and social skills. Yet disparities in cognitive skills between children from lower- and higher-income families emerge as early as kindergarten—and continue to develop over time. Investments in early childhood education, particularly for children most at risk of experiencing social exclusion, can be highly cost-effective to reduce these inequalities and prevent poverty from passing from one generation to another. Can promoting kindergarten participation for children from ethnic minorities increase early childhood development and reduce educational inequalities in Bulgaria?
Context of the evaluation
Bulgaria has experienced a recent increase in kindergarten enrollment rates following a 2010 law that made kindergarten education for five and six-year-old children compulsory and free. However, for children from ethnic minorities, who often come from lower socio-economic backgrounds, the impact of this policy remains unclear, as many municipalities still charge additional fees to cover school supplies and medical tests costs, potentially preventing parents from enrolling their child. Indeed, despite this government push, ethnic minority groups still fall behind in terms of kindergarten enrollment rates: In 2011, only 45 percent of children from Roma families were enrolled in kindergarten, compared to 75 percent of children nationally.
Details of the intervention
Researchers partnered with 23 NGOs, the Trust for Social Achievement (TSA), the World Bank, and the Open Society Institute to measure the impact of providing information and incentives on the kindergarten participation rates of children from minority ethnic groups, especially Roma children, in Bulgaria.
In 236 ethnically segregated communities in which there were at least 10 Roma households, researchers randomly assigned each community to one of four interventions:
- Free access to kindergarten education: This intervention covered the full cost of kindergarten education, including attendance fees and other costs related to school supplies and tests.
- Free access to kindergarten education plus a small conditional financial incentive: Households received free access to kindergarten education as described above and a monthly voucher of 7 Bulgarian Lev (about US $5) conditional on their child’s kindergarten attendance.
- Free access to kindergarten education plus a large conditional financial incentive: Households received free access to kindergarten education as described above and a monthly voucher of 20 Bulgarian Lev (about US $13) conditional on their child’s kindergarten attendance.
- Comparison group: Households received free access to kindergarten education, but researchers did not provide any financial incentive or support for parents to enroll their children or to cover additional school fees.
In addition, researchers randomly assigned half of the communities in each group to receive a mediation and information campaign and invited all households with children aged 3-6 in these communities to participate. This campaign consisted of five public community meetings lasting between 45 to 90 minutes organized by 23 NGOs over ten months. During the campaign, parents received information about the benefits of kindergarten education to increase their awareness about the importance of kindergarten for their children’s educational and professional development later in life, as well as to make them more at ease with the kindergarten environment in Bulgaria.
Researchers administered a baseline survey in April-May 2014 and an end-line survey a year later, collected community and kindergarten information, and conducted interviews with community and kindergarten representatives to measure the impact of the program on kindergarten participation and child learning and development, as well as on parents’ engagement in educational activities, aspirations for their children, and employment and income. In addition, researchers carried out three unannounced attendance checks.
To measure the medium-term impact of the program over four years, researchers used additional administrative data from the Ministry of Education and Science (MOES) and administered a school readiness test in May 2017. For this follow-up study, however, the main implementation partner ceased collaboration with five of the 23 NGOs initially involved the intervention, leading to only 70 percent of children receiving free access to kindergarten in the time period 2015-2019.
Results and policy lessons
All of the interventions increased kindergarten enrollment and attendance and improved parents’ aspirations for their children, but they also may have had some negative spillover effects on children from ethnic minorities who were already enrolled in kindergarten. Kindergarten had a negative impact on the learning outcomes of children from ethnic minorities one year after the program, while after an additional three years kindergarten may have been positively associated with child development.
Impact on kindergarten enrollment and participation: In the first year of the intervention, the programs increased kindergarten registration for all children by 18 to 41 percentage points, from a base of 68 percent of children who did not receive any intervention. Preschool attendance also increased by 6 to 18 percentage points, from a base of 52 percent in the comparison group. While both the small and the large financial incentive increased attendance for all children by around 18 percentage points, the impact of information alone or combined with incentives was insignificant. Overall, financial incentives alone were most efficient at improving both enrollment and attendance.
Impact on parental aspirations: The programs reduced the aspirational gap between parents from minority and majority ethnic groups, improving the aspirations parents from minority ethnic groups had for their children’s education and life outcomes such as appropriate age for marriage or childbearing. While parents of both boys and girls improved their aspirations, this impact was greater for girls. Providing information and incentives alone increased parental aspirations for girls by 0.31 and 0.37 standard deviations respectively and for boys by 0.25 and 0.23 standard deviations respectively. There was no significant impact on the aspirations of parents from majority ethnic groups, likely because they already had high—and therefore less malleable—aspirations.
Child learning and development: Despite substantially increasing kindergarten participation of Roma children, one year after the intervention, all interventions had a negative impact on learning for children who were not previously registered for kindergarten. On average, the program reduced child numeracy and literacy by 0.36 and 0.44 standard deviations, respectively. The program had no significant impact on children’s socio-emotional or motor skills.
The negative effects on child learning may be partly due to parents spending less time engaging in academic activities with their children at home, such as reading books, telling stories, playing with toys, singing, or naming/drawing/counting objects. As kindergarten registration and attendance rates increased, children spent less time at home benefitting from activities with their parents. Overall, the program decreased parental involvement by 1.2 standard deviations, as measured by a parental involvement index. However, while children from both ethnic minority and majority groups enjoyed fewer activities with their parents, learning decreased only for children in the former category. This may be due to teachers engaging less with children from ethnic minorities, as they lack teaching methods adapted to these children’s specific needs.
The follow up study suggests that by the end of year four, the school readiness of children from ethnic minorities seemed to have increased but that the program had a negative impact on children who were already enrolled at baseline, due to the influx of new peers into the classroom.
Use of Results:
Based on the research, the Bulgarian Ministry of Education and Sciences is currently planning the design of a national program to increase access to kindergarten for all children by eliminating kindergarten fees.