J-PAL North America’s Evaluation Toolkit is intended for research teams preparing to launch a prospective randomized evaluation.
Incorporating lessons learned through our own experience and guidance from researchers and research organizations, we provide practical guidance for designing, implementing, and communicating about evaluations. While most of the content in this toolkit is relevant across countries and contexts, certain elements are most applicable to research conducted in the United States or research that utilizes administrative data.
Please reach out to [email protected] with questions and feedback.
Choose a View:
This is an overview of the Evaluation Toolkit, including a checklist for researchers and their teams with resources grouped by topic.
Partnerships and Assessing Feasibility
What do we need to consider when exploring a new randomized evaluation, and how can we ensure the elements are in place for a strong research partnership? How can researchers determine whether a randomized evaluation is right for a particular program, and what questions should we ask of implementing partners to determine the likelihood of a successful randomized evaluation?
Once we have explored the potential intervention and determined that it makes sense to continue with the design process, how can we ensure that our study design is feasible and makes sense in the context of the intervention? How can we set processes in place to make sure the evaluation is running as planned?
Data Collection and Access
Determining what kinds of data will be necessary for a randomized evaluation will be a key consideration for project feasibility and study design. What data do we need to answer our research questions, how will we go about collecting and accessing data, and how will we use data when we have them?
Data Analysis and Sharing Results
Accessing and analyzing data may take significant time before results are ready to share or publish. How can we plan to use data once we have them and think about proactively managing expectations with stakeholders? After analysis is complete, what actions do we need to take to publish data and prepare to submit a paper to an academic journal?
This resource outlines steps to establish and build a strong working relationship with an implementing partner at the beginning of a randomized evaluation. Topics include questions to consider when...
This checklist provides guidance on the logistical and administrative steps that are necessary to launch a randomized evaluation that adheres to legal regulations, follows transparency guidelines...
Several challenges arise from the length and complexity of randomized evaluations, including the management of multiple data sources or multiple rounds of surveys, sensitive or personally identifiable...