Michal Krawczyk
Cited by*: None Downloads*: None

This paper reports a field experiment involving manipulation of invitations to register in an experimental economics subject database. Two types of invitations were sent out: one emphasizing pecuniary and the other non-pecuniary benefits of participation. The former resulted in higher response rate and the strength of this treatment effect was comparable in different groups defined by gender and academic major. In a follow-up test conducted about a year later it was found that individuals recruited by invitations emphasizing monetary benefits were less willing to make an effort to participate in a non-paid survey. The very same survey also showed that they were marginally less altruistic in general.
Haoran He, David Neumark, Qian Weng
Cited by*: None Downloads*: None

We explore compensating differentials for job flexibility, using a field experiment conducted on a Chinese job board. Our job ads differ randomly regarding when one works (time flexibility) and where one works (place flexibility). We find strong evidence that workers value job flexibility - especially regarding place of work. Application rates are higher to flexible jobs, conditional on the salary offered. Additional survey evidence indicates that workers are willing to take lower pay for more flexible jobs. Non-experimental job board data do not indicate that workers value job flexibility, reinforcing the difficulty of estimating compensating differentials from observational data.
Alec Brandon, John A List, Robert D Metcalfe, Michael K Price, Florian Rundhammer
Cited by*: None Downloads*: None

This study considers the response of household electricity consumption to social nudges during peak load events. Our investigation considers two social nudges. The first targets conservation during peak load events, while the second promotes aggregate conservation. Using data from a natural field experiment with 42,100 households, we find that both social nudges reduce peak load electricity consumption by 2 to 4% when implemented in isolation and by nearly 7% when implemented in combination. These findings suggest an important role for social nudges in the regulation of electricity markets and a limited role for crowd out effects.
Michal Krawczyk, Joanna Rachubik
Cited by*: None Downloads*: None

Despite having the same probability of being drawn, certain number combinations are more popular than others among the lottery players. One explanation of such preferences is the representativeness heuristic (RH). Unlike previous hypothetical experiments, in the present experiment we used real-life lottery tickets, involving a high payout in case of winning to elicit true preferences. To verify if people prefer randomly-looking number combinations, participants were to choose a preferred ticket. To validate if it is likely to be caused by RH, we correlated preference for "random" sequences with the belief in dependence between subsequent coin tosses. We confirm that people strongly prefer random sequences and that a non-trivial fraction believes in dependence between coin tosses. However, there is no correlation between these two tendencies, questioning the RH explanation. By contrast, participants who have an (irrationally) strong preference for number combinations also tend to make (irrationally) specific predictions in the coin task. Unexpectedly, we find that females are considerably more likely to belong to this groups than males.
Alec Brandon, John A List, Robert D Metcalfe, Michael K Price, Florian Rundhammer
Cited by*: None Downloads*: None

This study considers the response of household electricity consumption to social nudges during peak load events. Our investigation considers two social nudges. The first targets conservation during peak load events, while the second promotes aggregate conservation. Using data from a natural field experiment with 42,100 households, we find that both social nudges reduce peak load electricity consumption by 2 to 4% when implemented in isolation and by nearly 7% when implemented in combination. These findings suggest an important role for social nudges in the regulation of electricity markets and a limited role for crowd out effects.
Omar Al-Ubaydli, John A List, Claire Mackevicius, Min Sok Lee, Dana L Suskind
Cited by*: None Downloads*: None

Policymakers are increasingly turning to insights gained from the experimental method as a means to inform large scale public policies. Critics view this increased usage as premature, pointing to the fact that many experimentally-tested programs fail to deliver their promise at scale. Under this view, the experimental approach drives too much public policy. Yet, if policymakers could be more confident that the original research findings would be delivered at scale, even the staunchest critics would carve out a larger role for experiments to inform policy. Leveraging the economic framework of Al-Ubaydli et al. (2019), we put forward 12 simple proposals, spanning researchers, policymakers, funders, and stakeholders, which together tackle the most vexing scalability threats. The framework highlights that only after we deepen our understanding of the scale up problem will we be on solid ground to argue that scientific experiments should hold a more prominent place in the policymaker's quiver.
Greer K Gosnell, John A List, Robert D Metcalfe
Cited by*: None Downloads*: None

Increasing evidence indicates the importance of management in determining firms' productivity. Yet, causal evidence regarding the effectiveness of management practices is scarce, especially for high-skilled workers in the developed world. In an eight-month field experiment measuring the productivity of captains in the commercial aviation sector, we test four distinct management practices: (i) performance monitoring; (ii) performance feedback; (iii) target setting; and (iv) prosocial incentives. We find that these management practices -particularly performance monitoring and target setting- significantly increase captains' productivity with respect to the targeted fuel-saving dimensions. We identify positive spillovers of the tested management practices on job satisfaction and carbon dioxide emissions, and captains overwhelmingly express desire for deeper managerial engagement. Both the implementation and the results of the study reveal an uncharted opportunity for management researchers to delve into the black box of firms and rigorously examine the determinants of productivity amongst skilled labor.
Wojciech Hardy, Michal Krawczyk, Joanna Tyrowicz
Cited by*: None Downloads*: None

We report results of an experimental study analyzing the effects of Internet piracy on book sales. We conducted a year-long controlled large-scale field experiment with pre-treatment pair matching. Half of the book titles received experiment treatment, in which a specialized agency would immediately remove any unauthorized copy appearing on the Internet. For the other half we merely registered such occurrences, but no countermeasures were taken. For all the titles we obtained print and e-book sales statistics from the publishers. We find that removal of unauthorized copies was an effective method of curbing piracy, but this had no bearing on legal sales.
John A List
Cited by*: None Downloads*: None

No abstract available
Erwin Bulte, John A List, Daan van Soest
Cited by*: None Downloads*: None

Social scientists have recently explored how framing of gains and losses affects productivity. We conducted a field experiment in peri-urban Uganda, and compared output levels across 1000 workers over isomorphic tasks and incentives, framed as either losses or gains. We find that loss aversion can be leveraged to increase the productivity of labor. The estimated welfare costs of using the loss contract are quite modest -- perhaps because the loss contract is viewed as a (soft) commitment device.
John A List, Zacharias Maniadis, Fabio Tufano
Cited by*: None Downloads*: None

The sciences are in an era o fan alleged "credibility crisis'. In this study, we discuss the reproducibility of empirical results, focusing on economics research. By combining theory and empirical evidence, we discuss the import of replication studies, and whether they improve our confidence in novel findings. The theory sheds light on the importance of replications, even when replications are subject to bias. We then present a pilot meta-study of replication in experimental economics, a subfield serving as a positive benchmark for investigating the credibility of economics. Our meta-study highlights certain difficulties when applying meta-research (Ioannidis et al., 2015) and systematizing the economics literature.
Omar Al-Ubaydli, John A List
Cited by*: None Downloads*: None

Natural field experiments investigating key labour market phenomena such as unemployment have only been used since the early 2000s. This paper reviews the literature and draws three primary conclusions that deepen our understanding of unemployment. First, the inability to monitor workers perfectly in many occupations complicates the hiring decision in a way that contributes to unemployment. Second, the inability to determine a worker's attributes precisely at the time of hiring leads to discrimination on the basis of factors such as race, gender, age and ethnicity. This can lead to systematically high and persistent levels of unemployment for groups that face discrimination. Third, the importance of social and personal dynamics in the workplace can lead to short-term unemployment. Much of the knowledge necessary for these conclusions could only be obtained using natural field experiments due to their ability to combine randomized control with an absence of experimenter demand effects.
Andrew Dustan, Juan Manuel Hernandez-Agramonte, Stanislao Maldonado
Cited by*: None Downloads*: None

We study how non-monetary incentives, motivated by recent advances in behavioral economics, affect civil servant performance in a context where state capacity is weak. We collaborated with a government agency in Peru to experimentally vary the context of text messages targeted to civil servants in charge of a school maintenance program. These messages incorporated behavioral insights in dimensions related to information provision, social norms, and weak forms of monitoring and auditing. We find that these messages are a very cost-effective strategy to enforce compliance with national policies among civil servants. We further study the role of social norms and the salience of social benefits in a follow-up experiment and explore the external validity or our original results by implementing a related experiment with civil servants from a different national program. The findings of these new experiments support our original results and provide additional insights regarding the context in which these incentives may work. Our results highlight the importance of carefully designed non-monetary incentives as a tool to improve civil servant performance when the state lacks institutional mechanisms to enforce compliance.
Rudolf Kerschbamer, Daniel Neururer, Matthias Sutter
Cited by*: None Downloads*: None

Honesty is a fundamental pillar for cooperation in human societies and thus for their economic welfare. However, humans do not always act in an honest way. Here, we examine how insurance coverage affects the degree of honesty in credence good markets. Such markets are plagued by strong incentives for fraudulent behavior of sellers, resulting in estimated annual costs of billions of dollars to costumers and the society as a whole. Prime examples of credence goods are all kinds of repair services, the provision of medical treatments, the sale of software programs, and the provision of taxi rides in unfamiliar cities. We examine in a natural field experiment how computer repair shops take advantage of costumers' insurance for repair costs. In a control treatment, the average repair price is about EUR 70, whereas the repair bill increases by more than 80% when the service provider is informed that an insurance would reimburse the bill. Our design allows decomposing the sources of this economically impressive difference, showing that it is mainly due to the overprovision of parts and overcharging of working time. A survey among repair shops shows that the higher bills are mainly ascribed to insured costumers being less likely to be concerned about minimizing costs because a third party (the insurer) pays the bill. Overall, our results strongly suggest that insurance coverage greatly increases the extent of dishonesty in important sectors of the economy with potentially huge costs to costumers and whole economies.
John A List
Cited by*: None Downloads*: None

Last year I put together a summary of data from my field experiments website that pertained to framed field experiments. Several people have asked if I have an update. In this document I update all figures and numbers to show the details for 2020. I also include the description from the 2019 paper below.
Amanda Bayer, Syon Bhanot, Fernando Lozano
Cited by*: None Downloads*: None

No abstract available
Daniel Hedblom, Brent R Hickman, John A List
Cited by*: None Downloads*: None

We develop theory and a tightly-linked field experiment to explore the supply side implications of corporate social responsibility (CSR). Our natural field experiment, in which we created our own firm and hired actual workers, generates a rich data set on worker behavior and responses to both pecuniary and CSR incentives. Making use of a novel identification framework, we use these data to estimate a structural principal-agent model. This approach permits us to compare and contrast treatment and selection effects of both CSR and financial incentives. Using data from more than 110 job seekers, we find strong evidence that when a firm advertises work as socially-oriented, it attracts employees who are more productive, produce higher quality work, and have more highly valued leisure time. In terms of enhancing the labor pool, for example, CSR increases the number of applicants by 25 percent, an impact comparable to the effect of a 36 percent increase in wages. We also find an economically important complementarity between CSR and wage offers, highlighting the import of using both to hire and motivate workers. Beyond lending insights into the supply side of CSR, our research design serves as a framework for causal inference on other forms of non-pecuniary incentives and amenities in the workplace, or any other domain more generally.
Bharat Chandar, Uri Gneezy, John A List, Ian Muir
Cited by*: None Downloads*: None

Even though social preferences affect nearly every facet of life, there exist many open questions on the economics of social preferences in markets. We leverage a unique opportunity to generate a large data set to inform the who's, what's, where's, and when's of social preferences through the lens of a nationwide tipping field experiment on the Uber platform. Our field experiment generates data from more than 40 million trips, allowing an exploration of social preferences in the ride sharing market using bid data. Combining experimental and natural variation in the data, we are able to establish tipping facts as well as provide insights into the underlying motives for tipping. Interestingly, even though tips are made privately, and without external social benefits or pressure, more than 15% of trips are tipped. Yet, nearly 60% of people never tip, and only 1% of people always tip. Overall, the demand-side explains much more of the observed tipping variation than the supply-side.
Shubha Chakravarty, Mattias Lundberg, Plamen Nikolov, Juliane Zenker
Cited by*: None Downloads*: None

Lack of skills is arguably one of the most important determinants of high levels of unemployment and poverty. In response, policymakers often initiate vocational training programs in effort to enhance skill formation among the youth. Using a regression-discontinuity design, we examine a large youth training intervention in Nepal. We find, twelve months after the start of the training program, that the intervention generated an increase in non-farm employment of 10 percentage points (ITT estimates) and up to 31 percentage points for program compliers (LATE estimates). We also detect sizable gains in monthly earnings. Women who start self-employment activities inside their homes largely drive these impacts. We argue that low baseline educational levels and non-farm employment levels and Nepal's social and cultural norms towards women drive our large program impacts. Our results suggest that the program enables otherwise underemployed women to earn an income while staying at home - close to household errands and in line with the socio-cultural norms that prevent them from taking up employment outside the house.
Yun Liu, Elvis Cheng Xu
Cited by*: None Downloads*: None

Previous research has addressed the effects of corporate social responsibility (CSR) initiatives on consumer purchase intention (CPI). However, most of the empirical evidence is based on the analysis of mature large-scale firms; much less examines the effects of CSR initiatives on CPI in entrepreneurial contexts. In this study, we address this gap by investigating whether entrepreneurial start-ups' declaration of CSR engagement affects consumers' purchasing intent. We assert that consumers may consider firms' CSR engagement as a signal for unobserved product quality. We exploit a vignette experimental approach to test our theoretical predictions. In our experiment, participants received online invitations to subscribe to an electronic catalog that advertised various products supplied by entrepreneurial start-ups. The invitations are of five types, some of which presenting different CSR-related information on the suppliers to the participants. Overall, we find that the displayed information on CSR engagement promotes participants' willingness to subscribe to the electronic catalog, indicating that consumers will increase their purchase intentions for ethically oriented suppliers. Moreover, we find that among all the initiatives, external CSR initiatives (social contribution and environmental responsibility) promote consumers' intentions to purchase most effectively. To the best of our knowledge, our study is the first to explore the effects of different CSR initiatives on entrepreneurial start-ups in entrepreneurship literature. We highlight the heterogeneous effects of CSR initiatives on CPI, contributing new insights to research on CSR and consumer behavior.