Research Transparency and Reproducibility

PDF version

J-PAL has been awarded a three-year grant from the Alfred P. Sloan Foundation and the Laura and John Arnold Foundation to promote research transparency and reproducibility. There are four main objectives of this grant:

  1. Increase the number of studies registered on the AEA Social Science Registry to more than 1,000
  2. Publish more than 180 new datasets in trusted data repositories
  3. Facilitate the reproducibility of 36 studies through pre-publication reanalyses by J-PAL graduate student fellows
  4. Produce online training modules for research transparency and data management

J-PAL has also made a number of research resources available for research transparency and reproducibility here.

DATA PUBLICATION SERVICES

As part of its research transparency grant, J-PAL has committed ourselves and our affiliated researchers to publishing 180 datasets over the next three years. J-PAL offers a full suite of data publication services to J-PAL affiliates to increase the number of evaluations that contain datasets for public use. Our research team works with our affiliates to clean, curate, and finalize datasets before publishing them in our secure data repository.

Our support includes, but is not limited to:

    1. Cleaning and curation
  • General cleaning: recoding values, labeling or renaming variable labels, further commenting on code
  • Checking usability of data: for example, that there are variable labels and value codes
  • Ensuring no personally identifiable information (PII) is publicly released
  • Data validation and verification
  • Push-button replication of the study: checking that data and code produce the published results
  • Data publication
  • Publishing the completed dataset to the J-PAL Dataverse
  • Migrating previously published data from a personal website to a secure data repository (such as the J-PAL Dataverse) to ensure long-term sustainability of the data

If you are interested in learning more about these services, or you are a J-PAL affiliate and have studies that you would like to receive some assistance, please email [email protected].

Graduate student fellowships

J-PAL’s fellowship program offers financial support (tuition assistance of up to $12,000 and a stipend of $13,000) for one semester (approximately 4.5 months) for current PhD students. While preference will be given to students from economics programs, graduate students from other disciplines with strong quantitative and programming skills (STATA, R, etc.) are very welcome to apply. During the fellowship, students will work with some of J-PAL’s over 160 affiliated professors from dozens of universities around the world, re-analyzing randomized evaluations from scratch (starting with the creation of the dataset from “raw survey” data, up to production of the final econometric analysis included in the working papers). The purpose of this fellowship is create a collaborative environment for reproducing and replicating the data analyses included in these studies.

For Summer Fellows, we are offering a stipend on a per replication basis. Fellows will receive an allocated amount for each replication they complete. 

Future application periods are as follows:

Spring

  • Application Period: November 1 to November 14
  • Review Period: November 15 to November 30
  • Announcements: December 1-15
  • Start Date: On or around January 15

Summer

  • Application Period: February 9 to March 5
  • Review Period: March 5 to March 25
  • Announcements: March 30
  • Start Date: On or around June 15

Fall

  • Application Period: February 9 to March 5
  • Review Period: March 5 to March 25
  • Announcements: March 30
  • Start Date: On or around September 1

Fellowship Frequently Asked Questions

Meet the current fellows:

Florian Grosset Luke Sonnet
Florian Grosset
PhD candidate
Columbia University
Luke Sonnet
PhD candidate
UCLA

Job Opportunities

The Research Transparency Team is not currently looking to fill any positions.

Funding

Support is provided by the Alfred P. Sloan Foundation and the Laura and John Arnold Foundation.

Contacts

If you have any questions related to J-PAL's Research Transparency and Reproducibility work, please email [email protected].

James Turitto
Research Manager
Karl Rubio
Research Associate
Data Curation and Management
Keesler Welch
Research Associate
Trial Registry

News

Replication support for J-PAL evaluations now underway