Share
Jun 27, 2022
Chimple is now embarking on a journey of rigorous evaluation via a randomized controlled trial (RCT) of its teacher-led, at-home learning model in India, so that it is better prepared to be scaled up. There is an urgent need to build evidence on technology-based home-learning solutions, particularly in low-income contexts, so that we can understand what works, how it works, and whether it works at scale.
The Covid-19 pandemic has highlighted the importance of integrating technology in learning and teaching. EdTech solutions are enabling children to learn at home in sync with what is being taught in schools. They are also helping children learn at their own pace and levels with the help of games and activities that are fun and engaging. Gamification in learning goes a long way in harnessing children’s natural curiosity and their proclivities to experiment, explore, problem-solve, and stay engaged in meaningful activities[1]. The National Education Policy (NEP) 2020 too stresses that learning should be holistic, integrated, enjoyable and engaging. Technology can play a catalytic role in delivering these experiences to children at their homes.
Chimple, a non-profit EdTech organization based in Bangalore, has been an early-believer in technology-led playful learning. Founded in 2015, Chimple is a game-based app focused on improving core foundational literacy, numeracy, and digital skills for students in grades 1-3. The team was a finalist for the Global Learning XPRIZE (a global innovation challenge for education with a $15mn grand prize), won a $1M grant to further develop their solution, and test it via an evaluation in Tanzania, where they were able to demonstrate impressive learning gains in both math and language.[2]
Chimple is now embarking on a journey of rigorous evaluation via a randomized controlled trial (RCT) of its teacher-led, at-home learning model in India, so that it is better prepared to be scaled up. There is an urgent need to build evidence on technology-based home-learning solutions, particularly in low-income contexts, so that we can understand what works, how it works, and whether it works at scale. Chimple’s evaluation will help inform the interventions needed for such at-home learning models contextualized for India 2 and 3, especially for children in foundational grades.
Before the evaluation takes place, a coalition of researchers conducted a pilot study to understand how children and teachers can meaningfully engage with the app. CSF was part of this coalition. This article presents key findings from the study on what worked to boost engagement with Chimple.
Chimple’s theory of change is organized along two pillars: engage the child and involve the learning agents (teachers and parents).
This two-pronged approach serves to improve uptake, adoption, engagement, and retention in two ways – one, by creating in-app engagement hooks geared towards young children, and two, by creating an interface through which the teacher or parent can meaningfully connect the game to classroom instruction, and truly blend learning.
Since 2019, Chimple has been working to contextualize its offering to serve the Indian landscape via translations in language and content. It has pivoted its model from school-based to home-based during Covid-19 to reach as many students as it can via the Android PlayStore, and is now piloting innovative WhatsApp-based learning in partnership with the Nashik Municipal Corporation and Rocket Learning.
To prepare the model for evaluation, Chimple worked with a research coalition – consisting of Central Square Foundation, Chimple, Bharti Foundation’s Satya Bharti schools, and researchers from the University of Virginia and Wellesley College – to pilot the solution in a handful of schools (as part of the Bharti Foundation’s Satya Bharti Schools program) in academic year 2021-22, create feedback loops on the ground to learn from and refine the implementation, and set up the right processes for scale-up and research in the next academic year. By taking a phased approach to evaluation and by piloting the solution in a few schools first, the coalition was able to develop a strong product and program to achieve the desired learning time on the solution to best set it up for impact evaluation. The research coalition reviewed metrics from the product data weekly around these three key areas:
Chimple also conducted interviews with stakeholders on the field, including teachers and parents, to get qualitative insights into the health of the program. Despite strong initial engagement due to the novelty and excitement around the technology, they saw retention and engagement begin to dip over time. The iterative process allowed them to learn-as-they-went , and Chimple uncovered many interventions that worked to increase engagement with technology solutions, and many that did not. Many lessons were learned along the way, both on the product and program side, with implications for at-home and blended EdTech implementations in India and across the world.
The above learnings were incorporated into the final program design for the impact evaluation, which was launched in April 2022. Chimple will be evaluated by the same research coalition via a clustered RCT in 34 schools across five districts in the state of Haryana, covering close to ~1,400 children in treatment and control groups. This is going to be one of the first rigorous evaluations of an EdTech solution for foundational literacy and numeracy in India. The results from this study are intended to inform policy and intervention design for other blended and at-home learning solutions in India going forward.
Share this on