Papers - All

Daniel Hedblom, Brent R Hickman, John A List

Cited by*: Downloads*:

We develop theory and a tightly-linked field experiment to explore the supply side implications of corporate social responsibility (CSR). Our natural field experiment, in which we created our own firm and hired actual workers, generates a rich data set on worker behavior and responses to both pecuniary and CSR incentives. Making use of a novel identification framework, we use these data to estimate a structural principal-agent model. This approach permits us to compare and contrast treatment and selection effects of both CSR and financial incentives. Using data from more than 110 job seekers, we find strong evidence that when a firm advertises work as socially-oriented, it attracts employees who are more productive, produce higher quality work, and have more highly valued leisure time. In terms of enhancing the labor pool, for example, CSR increases the number of applicants by 25 percent, an impact comparable to the effect of a 36 percent increase in wages. We also find an economically important complementarity between CSR and wage offers, highlighting the import of using both to hire and motivate workers. Beyond lending insights into the supply side of CSR, our research design serves as a framework for causal inference on other forms of non-pecuniary incentives and amenities in the workplace, or any other domain more generally.

Omar Al-Ubaydli, John A List, Claire Mackevicius, Min Sok Lee, Dana L Suskind

Cited by*: Downloads*:

Policymakers are increasingly turning to insights gained from the experimental method as a means to inform large scale public policies. Critics view this increased usage as premature, pointing to the fact that many experimentally-tested programs fail to deliver their promise at scale. Under this view, the experimental approach drives too much public policy. Yet, if policymakers could be more confident that the original research findings would be delivered at scale, even the staunchest critics would carve out a larger role for experiments to inform policy. Leveraging the economic framework of Al-Ubaydli et al. (2019), we put forward 12 simple proposals, spanning researchers, policymakers, funders, and stakeholders, which together tackle the most vexing scalability threats. The framework highlights that only after we deepen our understanding of the scale up problem will we be on solid ground to argue that scientific experiments should hold a more prominent place in the policymaker's quiver.

Haoran He, David Neumark, Qian Weng

Cited by*: Downloads*:

We explore compensating differentials for job flexibility, using a field experiment conducted on a Chinese job board. Our job ads differ randomly regarding when one works (time flexibility) and where one works (place flexibility). We find strong evidence that workers value job flexibility - especially regarding place of work. Application rates are higher to flexible jobs, conditional on the salary offered. Additional survey evidence indicates that workers are willing to take lower pay for more flexible jobs. Non-experimental job board data do not indicate that workers value job flexibility, reinforcing the difficulty of estimating compensating differentials from observational data.

John A List, Zacharias Maniadis, Fabio Tufano

Cited by*: Downloads*:

The sciences are in an era o fan alleged "credibility crisis'. In this study, we discuss the reproducibility of empirical results, focusing on economics research. By combining theory and empirical evidence, we discuss the import of replication studies, and whether they improve our confidence in novel findings. The theory sheds light on the importance of replications, even when replications are subject to bias. We then present a pilot meta-study of replication in experimental economics, a subfield serving as a positive benchmark for investigating the credibility of economics. Our meta-study highlights certain difficulties when applying meta-research (Ioannidis et al., 2015) and systematizing the economics literature.

Omar Al-Ubaydli, John A List, Dana L Suskind

Cited by*: Downloads*:

Policymakers are increasingly turning to insights gained from the experimental method as a means of informing public policies. Whether-and to what extent-insights from a research study scale to the level of the broader public is, in many situations, based on blind faith. This scale-up problem can lead to a vast waste of resources, a missed opportunity to improve people's lives, and a diminution in the public's trust in the scientific method's ability to contribute to policymaking. This study provides a theoretical lens to deepen our understanding of the science of how to use science. Through a simple model, we highlight three elements of the scale-up problem: (1) when does evidence become actionable (appropriate statistical inference); (2) properties of the population; and (3) properties of the situation. We argue that until these three areas are fully understood and recognized by researchers and policymakers, the threats to scalability will render any scaling exercise as particularly vulnerable. In this way, our work represents a challenge to empiricists to estimate the nature and extent of how important the various threats to scalability are in practice, and to implement those in their original research.

Omar Al-Ubaydli, John A List

Cited by*: Downloads*:

Natural field experiments investigating key labour market phenomena such as unemployment have only been used since the early 2000s. This paper reviews the literature and draws three primary conclusions that deepen our understanding of unemployment. First, the inability to monitor workers perfectly in many occupations complicates the hiring decision in a way that contributes to unemployment. Second, the inability to determine a worker's attributes precisely at the time of hiring leads to discrimination on the basis of factors such as race, gender, age and ethnicity. This can lead to systematically high and persistent levels of unemployment for groups that face discrimination. Third, the importance of social and personal dynamics in the workplace can lead to short-term unemployment. Much of the knowledge necessary for these conclusions could only be obtained using natural field experiments due to their ability to combine randomized control with an absence of experimenter demand effects.

John A List

Cited by*: Downloads*:

"Putting Economic Research into Practice at Businesses (to Inform Science and Major Social Challenges)" Slides from ASSA NABE

Rudolf Kerschbamer, Daniel Neururer, Matthias Sutter

Cited by*: None Downloads*: None

Honesty is a fundamental pillar for cooperation in human societies and thus for their economic welfare. However, humans do not always act in an honest way. Here, we examine how insurance coverage affects the degree of honesty in credence good markets. Such markets are plagued by strong incentives for fraudulent behavior of sellers, resulting in estimated annual costs of billions of dollars to costumers and the society as a whole. Prime examples of credence goods are all kinds of repair services, the provision of medical treatments, the sale of software programs, and the provision of taxi rides in unfamiliar cities. We examine in a natural field experiment how computer repair shops take advantage of costumers' insurance for repair costs. In a control treatment, the average repair price is about EUR 70, whereas the repair bill increases by more than 80% when the service provider is informed that an insurance would reimburse the bill. Our design allows decomposing the sources of this economically impressive difference, showing that it is mainly due to the overprovision of parts and overcharging of working time. A survey among repair shops shows that the higher bills are mainly ascribed to insured costumers being less likely to be concerned about minimizing costs because a third party (the insurer) pays the bill. Overall, our results strongly suggest that insurance coverage greatly increases the extent of dishonesty in important sectors of the economy with potentially huge costs to costumers and whole economies.

John A List

Cited by*: Downloads*:

These are the slides from John A. List's keynote at the 2022 AFE conference.

Rocco Caferra, Alessia Casamassima, Alessandro Cascavilla, Andrea Morone, Paola Tiranzoni

Cited by*: Downloads*:

This work aims to identify and quantify the biases behind the anomalous behavior of people when they deal with the Three Doors dilemma, which is a really simple but counterintuitive game. Carrying out an artefactual field experiment and proposing eight different treatments to isolate the anomalies, we provide new interesting experimental evidence on the reasons why subjects fail to take the optimal decision. According to the experimental results, we can quantify the size and the impact of three main biases that explain the anomalous behavior of participants: Bayesian updating, illusion of control, and status quo bias.

Syon Bhanot

Cited by*: Downloads*:

Perception of peer rank, or how we can perform relative to out peers, can be a powerful motivator. While research exists on the effect of social information on decision making, there is less work on how ranked comparisons with our peers influence our behavior. This paper outlines a field experiment conducted with 3896 households in Castro Valley, California, which uses household mailers with various forms of social information and peer rank messaging to motivate water conservation. The experiment tests the effect of a visible peer rank on water use, and how the competitive framing of rank information influences behavioral response. The results show that households with relatively low or high water use in the pre-treatment period responded differently to how rank information was framed. I find that a neutrally-framed peer rank caused a small "boomerang effect" (i.e., an increase in average water use) for low water households, but this effect was eliminated by competitive framing. At the same time, a competitively-framed peer rank demotivated high water use households, increasing their average water use over the full period of the experiment. This result is supported by evidence that the competitive frame on rank information increased water use for households who ranked "last" in the peer group - a detrimental "last place effect" from competitively-framed rankings.

Indranil Goswami, Oleg Urminsky

Cited by*: Downloads*:

We present a complete empirical case study of fundraising decisions that demonstrates the importance of in-context field experiments. We first design novel matching-based fundraising appeals. We derive theory-based predictions from the standard impure altruism model and solicit expert opinion about the potential performance of our interventions. Both theory-based predictions and descriptive advice suggest improved fundraising performance from a framing intervention that credited donors for the matched funds (compared to a typical match framing). However, results from a natural field experiment with prior donors of a non-profit showed significantly poorer performance of this framing compared to a regularly framed matching intervention. This surprising finding was confirmed in a second natural field experiment, to establish the ground truth. Theoretically, our results highlight the limitations of both impure altruism models and of expert opinion in prediction complex "warm glow" motivation. More practically, our results question the availability of useful guidance, and suggest the indispensability of field testing for interventions in fundraising.

Hansika Kapoor, Savita Kulkarni, Anirudh Tagat

Cited by*: Downloads*:

This study aims to investigate intra-household bargaining outcomes elicited in an artefactual field experiment design where participants completed a purchase task of real commodities. Married couples separately expressed their initial preferences over commodities. The bargaining process in the experiment was exogenously introduced by sharing information about partners' preferences in the treatment group. We hypothesized that the spouse with weaker bargaining position at the household level would consider the information of their partner's preferences while making own consumption decisions more compared to their partner. Therefore, they may deviate from their own preferences when purchasing commodities. More than 230 married couples from two villages in the Tamil Nadu state of India participated in the experiment. It was observed that information about partners' spending preferences resulted in reduced final allocation for female participants. However, the deviation was not significantly different from the original intention to spend. Therefore, information about partners' preferences may not be an effective medium to elicit bargaining power in the context of jointly-consumed household commodities. Subgroup analyses were performed to identify any heterogeneous treatment effects.

James Andreoni, Amalia Di Girolamo, John A List, Claire Mackevicius, Anya Samek

Cited by*: Downloads*:

We conduct experiments eliciting risk preferences with over 1,400 children and adolescents aged 3-15 years old. We complement our data with an assessment of cognitive and executive function skills. First, we find that adolescent girls display significantly greater risk aversion than adolescent boys. This pattern is not observed among young children, suggesting that the risk gap in risk preferences emerges in early adolescence. Second, we find that at all ages in our study, cognitive skills (specifically math ability) are positively associated with risk taking. Executive functions among children, and soft skills among adolescents, are negatively associated with risk taking. Third, we find that greater risk-tolerance is associated with higher likelihood of disciplinary referrals, which provides evidence that our task is equipped to measure a relevant behavioral outcome. For academics, our research provides a deeper understanding of the developmental origins of risk preferences and highlights the important role of cognitive and executive function skills to better understand the association between risk preferences and cognitive abilities over the studied age range.

Laura Forastiere, Patrizia Lattarulo, Marco Mariani, Fabrizia Mealli, Laura Razzolini

Cited by*: Downloads*:

This paper revisits results from a field experiment conducted in Florence, Italy to study the effects of incentives offered to high school teens to motivate them to visit art museums and to identify best practices to transform this behavior into a long run cultural consumption. Students belonging to a first group of classes receive a flier with basic information and opening hours of a main museum in Florence, Palazzo Vecchio. Students in a second group of classes receive the flyer and a short presentation conducted by an art expert. Students in a third group of classes, in addition to the flyer and the presentation, receive also a nonfinancial reward in the form of extra-credit points towards their school grade. Taking a Principal Stratification approach, we explore the causal pathways that may lead students to increase their future museum attendance. Within the strata defined by compliance to the three forms of encouragement, we estimate associative and dissociative principal causal effects, that is, effects of the encouragement on the primary outcome, long run cultural consumption, that are associative or dissociative with respect to the effects of the encouragements on the Palazzo Vecchio visit. This analysis allows to interpret these effects as ascribable either to the encouragements, or to the museum visits, or to classroom spillovers. To face identification issues, estimation is performed with Bayesian inferential methods using hierarchical models to account for clustering. The main findings of the analysis are as follows: what seems to matter the most is the motivational incentive (i.e., the presentation), rather than the induced experience, i.e., the Palazzo Vecchio visit.

Omar Isaac Asensio, Magali A Delmas

Cited by*: 3 Downloads*: None

Little is known about the effect of message framing on conservation behavior over time. In a randomized controlled trial with residential households, we use advanced metering and information technologies to test how different messages about household energy use impact the dynamics of conservation behavior down to the appliance level. Our results, based on 374 million panel observations of kilowatt-hour (kWh) electricity consumption for 118 households over 9 months, show that differences in behavioral responses due to message framing become more significant over time. We find that a health-based frame, in which households consider the human health effects of their marginal electricity use, induced persistent energy savings behavior of 8-10% over 100 days; whereas a more traditional cost savings frame, drove sharp attenuation of treatment effects after 2 weeks with no significant savings versus control after 7 weeks. We discuss the implications for the design of effective information campaigns to engage households in conservation behavior.

Ran Kivetz, Oleg Urminsky, Yuhuang Zheng

Cited by*: Downloads*:

The goal-gradient hypothesis denotes the classic finding from behaviorism that animals expend more effort as they approach a reward. Building on this hypothesis, the authors generate new propositions for the human psychology of rewards. They test these propositions using a field experiment, secondary customer data, paper-and-pencil problems, and Tobit and logit models. The key finding indicate that (1) participants in a real cafe reward program purchase coffee more frequently the closer they are to earning a free coffee; (2) Internet users who rate songs in return for reward certificates visit the rating Web site more often, rate more songs per visit, and persist longer in the rating effort as they approach the reward goal; (3) the illusion of progress toward the goal induces purchase acceleration (e.g., customers who receive a 12-stamp coffee card with 2 preexisting "bonus" stamps complete the 10 required purchases faster than customers who receive a "regular" 10-stamp card) and (4) a stronger tendency to accelerate toward the goal predicts greater retention and faster reengagement in the program. The conceptualization and empirical findings are captured by a parsimonious goal distance model, in which effort investment is a function of the proportion of original distance remaining to the goal. In addition, using statistical and experimental controls, the authors rule out alternative explanations for the observed goal gradients. They discuss the theoretical significance of their findings and the managerial implications for incentive systems, promotions, and customer retention.

John A List

Cited by*: Downloads*:

No abstract available

Andreas Leibbrandt, John A List

Cited by*: Downloads*:

Labor force composition and the allocation of talent remain of vital import to modern economies. For their part, governments and companies around the globe have implemented equal employment opportunity (EEO) regulations to influence labor market flows. Even though such regulations are pervasive, surprisingly little is known about their impacts. We use a natural field experiment conducted across 10 U.S. cities to investigate if EEO statements in job advertisements affect the first step in the employment process, application rates. Making use of data from nearly 2,500 job seekers, we find considerable policy effects, but in an unexpected direction: the presence of an EEO statement dampens rather than encourages racial minorities willingness to apply for jobs. Importantly, the effects are particularly pronounced for educated job seekers and in cities with white majority populations. Complementary survey evidence suggests the underlying mechanism at work is "tokenism", revealing that EEO statements backfire because racial minorities avoid environments in which they are perceived as regulatory, or symbolic, hires rather than being hired on their own merits. Beyond their practical and theoretical importance, our results highlight how field experiments can significantly improve policy making. In this case, if one goal of EEO regulations is to enhance the pool of minority applicants, then it is not working.

Maria De Paola, Francesca Gioia, Vincenzo Scoppa

Cited by*: Downloads*:

We ran a field experiment to investigate whether individual performance in teams depends on the gender of the leader. About 430 students from an Italian University took an intermediate exam that was partly evaluated on the basis of teamwork. Students were randomly matched in teams of three and in each team we randomly chose a leader with the task of coordinating the work of the team. We find a positive and significant effect of female leadership on team performance. This effect is driven by the higher performance of team members in female led teams rather than due to an improvement in the leader's performance. We also find that, in spite of the higher performance of female led teams, male members tend to evaluate female leaders as less effective, whereas female members are more sympathetic towards them.