Our library of practical resources is intended for researchers and research staff undertaking randomized evaluations, as well as those teaching the technique to others, and anyone interested in how randomized evaluations are conducted.
Incorporating lessons learned through our own experience and through guidance from researchers and research organizations, we provide practical advice for designing, implementing, and communicating about evaluations. These resources are a collaborative effort. We credit the authors of all the resources we post here, and link to their original work wherever possible.
Please reach out to us at [email protected] or fill out this form with questions or feedback.
Introduction to Randomized Evaluations
Resources
A non-technical overview and step-by-step introduction for those who are new to randomized evaluations, as well as case studies and other teaching resources.
Before Starting a Project
Resources
Tips on successful field management and implementation partnerships for researchers who are new to fieldwork.
Project Planning
Resources
Highlights include: annotated checklist for designing an informed consent process, detailed advice on grant proposals and budgeting, and suggestions for proactive measures to help ensure ethical principles are followed in research design and implementation.
Research Design
Resources
Data Collection and Access
Resources
This section contains guidance specific to working with surveyors or survey companies, information about administrative data collection, and information applicable to all modes of data collection, such as on data security, data quality, and grant management.
Processing and Analysis
Resources
All the steps in a research project after the data was collected or assembled, from data cleaning to communicating results.
Teaching resources on randomized evaluations
Since 2005, J-PAL has offered its Evaluating Social Programs course in a number of different locations worldwide. This week-long course provides a thorough understanding of randomized evaluations and...
Working with a third-party survey firm
This resource provides guidance on when to work with an external survey firm, the process of identifying and contracting a firm, and how to coordinate tasks to ensure a successful study. It highlights...
Data publication
J-PAL promotes the publication of de-identified data from randomized evaluations 1. This resource provides guidance on doing so in the form of a checklist for preparing data for submission. It also...
Data analysis
This guide provides an overview of data analysis for randomized evaluations in order to estimate causal impact. It is intended to provide something of a starting point and orient individuals not...
Power calculations
This section is intended to provide an intuitive discussion of the rationale behind power calculations, as well as practical tips and sample code for conducting power calculations using either built...
Randomization
Randomization for causal inference has a storied history. Controlled randomized experiments were invented by Charles Sanders Peirce and Joseph Jastrow in 1884. Jerzy Neyman introduced stratified...
Survey design
This section covers the essentials of survey design. It includes an overview of survey development, practical tips, formatting suggestions, and guides to translation and quality control.
Survey programming
This resource covers best practices for programming a survey using computer assisted personal interview (CAPI) software. We primarily rely on examples using SurveyCTO, which is widely used by J-PAL...