The Impact of Energy Efficiency Messaging on Audit Takeup and Investment in Wisconsin

Fieldwork by:
Location:
Wisconsin, United States of America
Sample:
101,881 households
Timeline:
2012 - 2013
Target group:
  • Urban population
Outcome of interest:
  • Technology adoption
  • Energy conservation
Intervention type:
  • Audits
  • Information
  • Monetary incentives
AEA RCT registration number:
AEARCTR-0002176
Partners:

Energy efficiency programs are included in many climate mitigation strategies. Despite their potential environmental and monetary benefits, takeup of energy efficient investments has been limited to date. Researchers examined the informational, behavioral, and monetary drivers behind takeup of residential energy efficiency audits and subsequent investments in Wisconsin. While receipt of promotional letters and subsidies did induce higher rates of audit participation, overall takeup and investment in energy efficient home solutions remained low and realized energy savings fell short of predicted models.

Policy issue

Many climate mitigation plans – which seek to reduce the emission of greenhouse gases – assign a key role to energy efficiency programs. In theory, energy efficiency investments could generate not only environmental but also monetary benefits. A recent study indicates adoption of such programs in the United States may generate US$700 billion in consumer savings.1

Despite projected energy cost savings, takeup of energy efficient investments remains limited. Previous research suggests that misinformation, consumer preferences, and the fact that environmental costs of energy consumption are borne out across society, rather than concentrated among individuals, are potential barriers to takeup. To test these assumptions, researchers examined the impact of residential energy efficiency program messaging on consumers’ investment behaviors and resulting social welfare.

Context of the evaluation

This randomized evaluation coincided with two US-federally-funded energy efficiency initiatives in Wisconsin: Green Madison and Milwaukee Energy Efficiency. These agencies provided “residential energy efficiency retrofit programs” to interested homeowners. Eligible households included all owner-occupied single-family homes in Madison and Milwaukee that were built in 1990 or before, had no lien on the property, and had not scheduled an audit prior to June 2012.

Interested households could schedule an audit with an “Energy Consultant” at a subsidized cost. During the audit, consultants often installed quick energy savings products, free of charge, including energy-efficient lightbulbs and faucet aerators. The consultants then provided a detailed audit report with recommended energy efficiency investments, including projected upfront cost, simulation predictions of annual energy cost savings, payback period, and lifetime energy savings for each investment. Audited households could subsequently choose whether to pursue any of the recommended energy efficiency investments.

Electrician installing energy efficient lightbulbs
Installing energy efficient lightbulbs. Photo: Shutterstock.com

Details of the intervention

Researchers partnered with Green Madison and Milwaukee Energy Efficiency to conduct a randomized evaluation examining the informational, behavioral, and monetary drivers behind energy audit takeup and investment. Of 101,881 households (31,213 in Madison and 70,668 in Milwaukee), researchers randomly assigned 79,994 households to receive two promotional letters by direct mail that advertised the energy efficiency programs in their respective cities between June 2012 and February 2013. The remaining 21,887 households served as a comparison group and received no promotional mailings but could still choose to audit.

Households that received promotional letters were also randomly assigned to one of seven variations that highlighted different program components and benefits. All letters described the program, offered next steps to participate, and provided contact information to schedule a home energy audit.

To test whether increasing awareness of the program improves takeup, letters contained varying levels of information regarding:

  • the private and social benefits of energy efficiency investments to determine whether misinformation or biased beliefs may influence takeup;
  • low-interest financing options for investments to identify whether a lack of credit or access to loans reduced demand; and
  • comparisons between the program’s energy savings versus other energy use decisions to test how consumer beliefs about energy use may impact their investment decisions.

To test how consumer behavioral decisions affect takeup, letters varied the:

  • potential benefits of weatherization (saving money, local and global environmental protection, and a more comfortable home) by varying the topline images and headlines to determine whether visual primes may activate an idea or motivation to act;
  • time period through which the benefit was framed (one-year vs. seven-year total) in response to existing research that indicates consumers may have difficulty aggregating savings over time; and
  • language used to describe the program’s first step (audit vs. assessment) in response to concern that “audit” may have negative associations (e.g. with taxes).

Finally, to test how cost influences takeup decisions, some letters offered monetary incentives, which varied along the following lines:

  • an immediate $100 audit subsidy for six percent of households;
  • an immediate $25 audit subsidy for 23 percent of households;
  • a $25 Visa Reward Card upon audit completion for 20 percent of households; and
  • no monetary incentive, instead listing the regular (already subsidized) audit cost for 51 percent of households.

Researchers monitored whether subjects opted to complete home audits and, if so, whether they subsequently invested in any of the recommended energy saving solutions. In addition, researchers collected energy use data for customers who completed energy audits but could not obtain data for those households who chose not to complete an audit. Researchers used the data on energy consumption to compare the predicted energy cost savings to realized savings after six months as well as to evaluate the social welfare consequences of program participation.

Results and policy lessons

Results indicate that while receipt of promotional letters and audit subsidies did induce higher rates of audit participation, few households made subsequent investments in energy efficient home solutions and the return on these investments fell short of projected cost savings.

Audit takeup: Promotional letters with zero monetary incentives only minorly increased audit participation. Households that received letters were 0.16 percentage points (13 percent) more likely to complete a home audit compared to households that were not recipients of the direct mailing campaign. However, informational and behavioral variations in letter content did not systematically affect audit participation rates. Taken together, these results suggest that basic lack of awareness of the program was not a major barrier to takeup.

Providing audit subsidies induced somewhat higher levels of home audit participation, but even with subsidies demand for audits remained low. Of those households that received the US$100 subsidy, only 1.8 and 2.2 percent of households in Milwaukee and Madison, respectively, decided to audit their homes. Nevertheless, households that received a US$100 subsidy were 0.53 percentage points (32 percent) more likely to complete an audit than those in the comparison group.

Investments in energy efficiency: Households that took up the audit due to the subsidized price were less likely to invest in energy efficient retrofits than their peers who opted to audit without monetary incentives. Households that received the US$100 subsidy were 13 percentage points (32 percent) less likely to invest than households that received no financial incentive, 54 percent of which made energy investments. One policy implication is that programs interested in maximizing investments per subsidy dollar should think carefully about what to subsidize - for instance, the audit itself or the subsequent investment.

Cost simulations and social welfare: The projected model failed to accurately simulate energy cost savings for consumers. Average household cost savings from energy efficiency updates equaled US$89 per year, or 58 percent of the projected US$153 in annual savings. Identifying this discrepancy is key for refining simulation models that inform consumer and policymaker decisions. Furthermore, using energy consumption data, researchers calculated that social welfare fell by US$0.18 per subsidy dollar, suggesting that subsidies could be better calibrated.

1.
McKinsey & Co. 2009. “Unlocking Energy Efficiency in the U.S. Economy.” https://www.mckinsey.com/~/media/mckinsey/dotcom/client_service/epng/pdfs/unlocking%20energy%20efficiency/us_energy_efficiency_exc_summary.ashx.