Longitudinal Midterm Report for the Tayari Early Childhood Development and Education Programme

Midterm evaluation of longitudinal study conducted through the Tayari Early Childhood Development and Education Programme. Tayari is an intervention implemented by the Kenyan Ministry of Education and four counties, with technical support from RTI International and funding from the Children’s Investment Fund Foundation (CIFF). Tayari is focused on designing, piloting and testing the cost effectiveness of investments to increase school readiness for children in Early Childhood Development and Education (ECDE) centres in Uasin Gishu, Siaya, Laikipia and Nairobi counties.

Tayari’s Longitudinal Evaluation Midline Results

Presentation delivered at CIES 2017 (Atlanta). The Tayari intervention’s randomized controlled trial design is structured to allow for causal inference of Tayari’s impact on school readiness. Previous research has shown how similar ECD programs have affected learning outcomes, but the literature remains silent on how individual children’s skills transition over time. The Tayari longitudinal research design allows us to estimate growth trajectories of individual children. This is particularly salient as the literature lacks models for how literacy and numeracy skills interact with the executive functioning and socioemotional skills that Tayari investigates interact with each other over time. The Tayari longitudinal study follows more than 3100 learners across three rounds of data collection and a wider range of sills than is available in the Tayari impact evaluation. Given how little is known about how children’s core ECD skills grow, the Tayari longitudinal intervention estimates first how the skills grow in the normal control condition, and then how the Tayari program affects growth rates and relationships between learning elements. Finally, the Tayari longitudinal study will continue to develop an understanding of how children transition skills between the two levels of pre-primary in Kenya to the primary education sector where the Tusome literacy program is being implemented at national scale.

Theory based evaluation in Kenya: Using research to inform national scale implementation

Presentation delivered at CIES 2017 (Atlanta).

What Have We Learned? Improving Development Policy through Impact Evaluation (Presentation)

From the CGD Website on the event: "Please join the Center for Global Development (CGD) and the Abdul Latif Jameel Poverty Action Lab (J-PAL) to take stock of the evidence and impact evaluation movement and its promise for improving social policy in developing countries. In 2006, CGD released a working group report titled “When Will We Ever Learn? Improving Lives Through Impact Evaluation.” It described an evaluation gap and proposed an international effort to systematically build evidence on “what works” in development with the aim of improving the effectiveness of social programs. Ten years later, we will reflect on progress toward these goals. Despite a host of challenges, hundreds of millions of people across the world have benefited from programs that have been rigorously evaluated and scaled up. Impact evaluation has generated knowledge about poverty and public policy leading to better programs. At the event, policymakers and evaluators will discuss examples of how evaluation has helped enhance effectiveness, and a panel of evaluation funders will reflect on lessons learned and the way forward. In a time of political transition, we seek to re-energize the movement for increased evidence and value for money in public and aid spending. Among others, the event will feature: Abhijit Banerjee (MIT), Amanda Glassman (CGD), Rachel Glennerster (J-PAL), Markus Goldstein (World Bank), Amber Gove (RTI International), Rema Hanna (Harvard), Emannuel Jimenez (3ie), Michael Kremer (Harvard), Darius Mogaka (Government of Kenya), Santhosh Mathew (Government of India), William Savedoff (CGD), and Bambang Widianto (Government of Indonesia)." Download the presentation slides from the Kenya case study using the "Download" link, or click on the external website link for more information on the event.

Classroom-up policy change: Early reading and math assessments at work

This article reviews the development of the EGRA and EGMA, which are locally tailored, timely assessments designed to directly inform policy and instruction for learning improvement, particularly for countries on the lower end of the income spectrum. The history of the design and implementation of the tools as well as case studies of their use in Egypt and Kenya, are a useful counterbalance to the experience of the more traditional international large-scale assessments (ILSAs) documented in this special issue—in particular for understanding the needs of countries struggling to transform ‘education for all’ into ‘learning for all’.

Pro-poor PRIMR: Improving early literacy skills for children from low- income families in Kenya

Article published in Africa Education Review, Volume 12, 2015 - Issue 1. Published Abstract: Children from low-income families are at risk of learning outcome difficulties, particularly in literacy. Various studies link poor literacy results with performance later in primary and secondary school, and suggest that poverty, literacy skills and weak instructional methods combine to drastically limit the educational opportunities for many poor children. The Primary Math and Reading (PRIMR) Initiative was designed to support the learning gains of Class 1 and 2 pupils in seven counties across Kenya. PRIMR uses a randomised controlled trial design to establish the effect of its intervention and employs basic literacy measures to estimate causal effects. This study shows that PRIMR has been effective for children from low-income families and that early literacy interventions can mitigate socio-economic effects. The findings suggest that efforts to improve literacy outcomes for the poor should begin early in primary school. Strategies for ensuring that instruction is equitable across socio-economic status are advocated.

Improving procedural and conceptual mathematics outcomes: evidence from a randomised controlled trial in Kenya

Article published in the Journal of Development Effectiveness, Volume 8, 2016 - Issue 3. Published Abstract: To improve learning outcomes, an intervention in Kenya called the Primary Math and Reading (PRIMR) Initiative provided pupil learning materials, teachers’ guides and modest teacher professional development in mathematics. This paper presents the causal impact of PRIMR’s mathematics intervention on pupil achievement indices for procedural and conceptual numeracy, using a differences-in-differences analytic strategy. The mathematics intervention produced modest, statistically significant results: generally similar results for males and females, a larger impact in grade 2 than grade 1, a larger impact in nongovernment schools than public schools, and smaller outcomes in mathematics than for English or Kiswahili. These findings have relevant policy implications in Kenya given an impending national mathematics programme.

Implementing Mother Tongue Instruction in the Real World: Results from a Medium-Scale Randomized Controlled Trial in Kenya

Article published in Comparative Education Review. Published abstract: Research in sub-Saharan Africa investigating the effect of mother tongue (MT) literacy instruction at medium scale is limited. A randomized controlled trial of MT literacy instruction was implemented in 2013 and 2014 as part of the Primary Math and Reading (PRIMR) Initiative in Kenya. We compare the effect of two treatment groups—the base PRIMR program teaching literacy in English and Kiswahili and the PRIMR-MT program, which taught literacy in English, Kiswahili, and mother tongue—in two different language environments. Implementation of the MT program faced challenges because many educators were not speakers of the languages, some communities resisted mother tongue instruction, and some areas were more language heterogeneous. Effect sizes on MT literacy averaged between 0.3 and 0.6 standard deviations. The base PRIMR program also increased MT learning outcomes in some measures but had smaller effects than the PRIMR-MT program in oral reading fluency and comprehension.

Reading the script: How the scripts and writing systems of Ethiopian languages relate to letter and word identification

Article published in Writing Systems Research. Published Abstract: Reading research suggests that script type and writing systems have a relationship with children’s ability to recognise letters, syllables and words. In Ethiopia, the scripts used for writing language differ by visual complexity and the psycholinguistic grain size of the script. The Ge’ez-script languages have alphasyllabic-based writing systems, while the Latin-script languages have phoneme-based writing systems. These differences in script and the differences in aspects of the writing system influence early reading acquisition. We exploited a large, regionally representative data set assessing a variety of early reading tasks in six Ethiopian languages to estimate the impact of script and aspects of writing system differences on early reading outcomes in the areas of letter identification, word reading, non-word decoding and story reading. We made comparisons between language outcomes using Ge’ez and Latin scripts, controlling for student background and school socio-economic status (SES). Additional analyses compared across-script and writing system differences within regions and gender. We found that Ethiopian script and writing system differences have implications for instructional methods for letter identification and word decoding.

Does technology improve reading outcomes? Comparing the effectiveness and cost-effectiveness of ICT interventions for early grade reading in Kenya

Article published in the International Journal of Educational Development, Volume 49, July 2016, Pages 204–214. Published abstract: Education policymakers are investing in information and communications technology (ICT) without a research base on how ICT improves outcomes. There is limited research on the effects of different types of ICT investments on outcomes. The Kenya Primary Math and Reading (PRIMR) study implemented a randomized controlled trial comparing the effects and cost of three interventions – e-readers for students, tablets for teachers, and the base PRIMR program with tablets for instructional supervisors. The results show that the ICT investments do not improve literacy outcomes significantly more than the base non-ICT instructional program. Our findings show that cost considerations should be paramount in selecting ICT investments in the education sector.