How Boston, Chicago, and New York City Leveraged Data and Evidence to Expand—and Improve—Summer Jobs Programs
This story was originally published in Results for America's Substack The Department of What Works.
The days are getting colder, but summer jobs programs are already beginning to plan for next year. These city-managed programs pair young people ages 14-24 with paid, part-time opportunities to work for nonprofits, community organizations, government agencies, and local businesses. These programs also provide training and support services, such as soft skills development or mentoring. Many policymakers have long viewed these programs as a way to help youth stay out of trouble while school is out of session while also gaining work experience and earning income.
Summer jobs programs have operated since the 1960s, but it’s only relatively recently that a rigorous evidence base on their impact began to emerge. While participants, employers, and community organizations often reported positive experiences, policymakers still faced important questions. Did summer jobs impact career pathways? Could they help to reduce youth involvement in violence or crime? Did their impact justify sustained public investment?
Over the past decade, city governments in Boston, Chicago, and New York City engaged in long-term partnerships with academic researchers to evaluate summer jobs programs and generate one of the strongest evidence bases for municipal youth programs in the United States. The outcomes they examined included measures of criminal justice involvement such as rates of arrest and incarceration, education outcomes such as attendance and graduation, employment and earnings over time, as well as mortality. Many of these researchers are affiliated with J-PAL North America, a research and policy center based at MIT whose mission is to reduce poverty by ensuring policies are informed by scientific evidence, and where I lead efforts to support governments in scaling proven programs. We recently released a new case study in J-PAL’s Evidence to Policy series that explores how these cities were able to produce and leverage rigorous evidence to scale their summer jobs programs.
Each of the three cities first began working with researchers because they had a question about how summer jobs programs were impacting outcomes in a priority policy area. These popular programs often have more applicants than available spots, which presents an opportunity for using randomized evaluations to understand their impact. The research teams conducted lotteries for the limited openings, providing both a fair way to distribute the slots and a way to rigorously measure the impact of the programs across a range of outcomes. But these research partnerships did more than generate journal articles: the evidence they produced helped to build political support, improve implementation, and enabled governments to sustain investments in effective programs over time.
New York
The New York City Summer Youth Employment Program (SYEP) has operated since 1963, but did not undergo a rigorous evaluation until the city partnered with researchers to evaluate the impact of the program between 2005 and 2008. The resulting studies found that participation reduced arrests and lowered incarceration and mortality rates. Summer earnings increased, but there was little impact on long-term labor-market effects. The findings confirmed a long-time assumption that summer jobs were not only an employment program. They were improving public safety and helping vulnerable young people spend out of school time in positive ways. When former Mayor Eric Adams announced an expansion of the city’s SYEP from 75,000 to 100,000 jobs, the administration cited research demonstrating the program’s impact on criminal justice outcomes.
Research findings not only helped grow the program, they helped reshape how the agency thought about implementation, including which youth populations might benefit most and how services could be delivered more effectively. While the long-term employment impacts of the program were less than officials had hoped, this also became its own opportunity. The strength of the relationship led city staff to trust researcher suggestions on exploring areas of innovation, such as providing participants with letters of recommendation that could help communicate workplace skills to future employers. That willingness to test refinements to the underlying model has created promising new avenues for program design.
Chicago
In Chicago, a spike in youth violence created special urgency to determine what investments in public programs might help save lives. That question led to the creation and evaluation of One Summer Chicago Plus, a pilot summer jobs program designed specifically for youth attending high-violence high schools. The findings for public safety were striking. For the 2012 and 2013 cohorts, arrests for violent crime fell by more than half during the year following participation.
The credibility of those results helped attract additional investment. Following publication of the findings, city leaders secured $10 million in philanthropic funding to continue and expand the program. They also conducted another evaluation, which confirmed that the model fundamentally worked when it continued to find reductions in arrests even as the program evolved. The program has become so integral to Chicago that the city cited summer employment research in its Covid-19 Recovery Plan.
Boston
In Boston, an evaluation of the summer jobs program found that participation reduced criminal justice engagement while also increasing the likelihood that participants would graduate on time. Many of the improvements in academic outcomes were driven by improvements in work habits (e.g., showing up on time) and higher academic and career aspirations. Rather than approaching evaluation as a one-time exercise, researchers and practitioners used it as a jumping off point for continuous learning and improvement for over a decade. The relationship has been characterized by continuous engagement between researchers and city staff to identify and test operational improvements and answer policy-relevant questions. The ongoing credibility of their work has created scaffolding for major investments by the city. In 2024, Boston formalized its commitment to summer jobs through the Youth Jobs Guarantee, designed to ensure every eligible public school student can access a job opportunity. By summer 2025, the city placed more than 10,500 young people in jobs through partnerships with more than 200 organizations.
Takeaways
In each city, researchers and public officials worked together to answer questions that mattered to policymakers. They used rigorous methods, shared data, built trust over years (rather than months), and remained willing to adjust programs based on what they learned. As a result, the evidence they produced did more than publish journal articles. It built political support, improved implementation, and helped governments sustain investments over time. Today, those programs continue serving tens of thousands of young people each year, backed not only by tradition or intuition, but by evidence. Combined, these programs currently serve over 141,000 youth each summer.
These stories from New York, Boston, and Chicago highlight the potential power of academic-practitioner partnerships, demonstrating why J-PAL North America continues to foster and champion these collaborations as a core part of our work. State and local governments are uniquely positioned to experiment with new policy ideas, often moving faster than federal agencies to pilot and refine solutions. This makes them critical partners in testing poverty-reduction strategies and scaling evidence-based solutions. Despite the potential of academics and local policymakers working together, the two groups often struggle to connect. And when they do, they may lack the resources or incentives to invest in developing and completing rigorous evaluations. J‑PAL works to bridge that gap, catalyzing research partnerships—and building evaluation capacity—to help policymakers understand the impact of their programs while expanding the evidence base on effective strategies to reduce poverty.
Today, J-PAL is working to enable even more cities to use data and evidence to improve and potentially scale their summer youth employment programs through a Community of Practice we are co-implementing with Dr. Alicia Modestino at Northeastern University, the long-time research partner of Boston. To learn more about the Summer Youth Employment Community of Practice and related opportunities, please visit the J-PAL North America summer jobs homepage or reach out to [email protected].
Related Content
Building research partnerships to understand the promises of Summer Youth Employment Programs
Building research partnerships to understand the promises of Summer Youth Employment Programs, part two