John A List
Cited by*: None Downloads*: None

Last year I put together a summary of data from my field experiments website that pertained to natural field experiments. Several people have asked me if I have an update. In this document I update all figures and numbers to show the details for 2020. I also include the description from the 2019 paper below.
John A List
Cited by*: None Downloads*: None

In 2019, I put together a summary of data from my field experiments website that pertained to artefactual field experiments. Several people have asked me if I have an update. In this document I update all figures and numbers to show the details for 2021. I also include the description from the 2019 paper below.
Alec Brandon, John A List, Robert D Metcalfe, Michael K Price, Florian Rundhammer
Cited by*: None Downloads*: None

This study considers the response of household electricity consumption to social nudges during peak load events. Our investigation considers two social nudges. The first targets conservation during peak load events, while the second promotes aggregate conservation. Using data from a natural field experiment with 42,100 households, we find that both social nudges reduce peak load electricity consumption by 2 to 4% when implemented in isolation and by nearly 7% when implemented in combination. These findings suggest an important role for social nudges in the regulation of electricity markets and a limited role for crowd out effects.
Gary Charness, John A List, Aldo Rustichini, Anya Samek, Jeroen van de Ven
Cited by*: None Downloads*: None

Theory of Mind (ToM), the ability to correctly attribute mental states to others, is important in social interactions. We evaluate the development of ToM in about 800 mostly disadvantaged children. We next conduct a field experiment with about 160 children in which we find that the low ToM rates for these disadvantaged children improve substantially in environments where the presence of other children is made salient. We see that ToM performance increases for both younger and older children in the treatment with strong salience, but that the treatment with weaker salience seems to be only effective in improving the ToM rates for older children.
John A List
Cited by*: None Downloads*: None

This review summarizes the historical place of the seminal contribution of Kahneman et al. (1990), from origins to theory to catalyst of an entire area of scholarship. This new literature has produced evidence both in concert with the original KKT conclusions as well as evidence refuting certain insights from KKT. The general theme of my summary is that even imperfect papers can have deep impact, both within and outside the academy; a lesson that today's critics should consider as young experimentalists continue to fight the tyranny of the top 5.
Syon Bhanot
Cited by*: None Downloads*: None

Social norms messaging campaigns are increasingly used to influence human behavior, with social science research generally finding that they have modest but meaningful effects. One aspect of these campaigns in practice has been the inclusion of injunctive norms messaging, designed to convey a social judgement about one's behaviors (often in the form of encouraging or discouraging language, or a visual smiley or frowny face). While some prominent research has provided support for the use of such messaging as a tool for positive behavior change, causal evidence on the effect of injunctive norms messaging as a motivator (as opposed to just one part of a multifaceted messaging campaign) is limited. This paper presents a field experiment on water conservation behavior conducted by an organization in California, involving over 40,000 households, which provides some of the most precise evidence to date regarding the effect of injunctive norms on decision making. I find that not only do injunctive norms encourage conservation behavior, there is also no evidence that they discourage individuals from further attending norms messaging-regardless of whether the social judgement conveyed is negative or positive. Taken together, this suggests that injunctive norms are a useful tool in "nudge"-style campaigns tackling behavior change.
John A List
Cited by*: None Downloads*: None

Last year I put together a summary of data from my field experiments website that pertained to artefactual field experiments. Several people have asked me if I have and update. In this document I update all figures and numbers to show the details for 2020. I also include the description from the 2019 paper.
Eduardo Fe, David Gill, Victoria Prowse
Cited by*: None Downloads*: None

We investigate how childhood cognitive skills affect strategic sophistication and adult outcomes. In particular, we emphasize the importance of childhood theory-of-mind as a cognitive skill. We collected experimental data from more than seven hundred children in a variety of strategic interactions. First, we find that theory-of-mind ability and cognitive ability both predict level-k behavior. Second, older children respond to information about the cognitive ability of their opponent, which provides support for the emergence of a sophisticated strategic theory-of-mind. Third, theory-of-mind and age strongly predict whether children respond to intentions in a gift-exchange game, while cognitive ability has no influence, suggesting that different measures of cognitive skill correspond to different cognitive processes in strategic situations that involve understanding intentions. Using the ALSPAC birth-cohort study, we find that childhood theory-of-mind and cognitive ability are both associated with enhanced adult social skills, higher educational participation, better educational attainment, and lower fertility in young adulthood. Finally, we provide evidence that school spending improves theory-of-mind in childhood.
Rocco Caferra, Roberto Dell'Anno, Andrea Morone
Cited by*: None Downloads*: None

This paper aims to unmask the inadequacy of the review process of a sample of fee-charging journals in economics. We submitted a bait-manuscript to 104 academic economic journals to test whether there is a difference in the peer-review process between Article Processing Charges (APC) journals and Traditional journals which do not require a publication fee. The submitted bait-article was based on completely made-up data, with evident errors in terms of methodology, literature, reporting of results, and quality of language. Nevertheless, about half of the APC journals fell in the trap. Their editors accepted the article in the journals and required to pay the publication fee. We conclude that the Traditional model has a more effective incentive-mechanism in selecting articles, based on quality standards. Otherwise, we confirm that the so-called "Predatory Journals" - i.e. academic journals which accept papers without a quality check - exploit the APC scheme to increase their profits. They are also able to enter whitelists (e.g. Scopus, COPE). Accordingly, poor-quality articles published on APC journals shed the lights on the weakness of methodologies based on a mechanical inclusion of academic journals in scientific database indexes, succeeding in being considered for bibliometric evaluations of research institutions or scholars' productivity.
Eszter Czibor, David Jimenez-Gomez, John A List
Cited by*: None Downloads*: None

What was once broadly viewed as an impossibility - learning from experimental data in economics - has now become commonplace. Governmental bodies, think tanks, and corporations around the world employ teams of experimental researchers to answer their most pressing questions. For their part, in the past two decades academics have begun to more actively partner with organizations to generate data via field experimentation. While this revolution in evidence-based approaches has served to deepen the economic science, recently a credibility crisis has caused even the most ardent experimental proponents to pause. This study takes a step back from the burgeoning experimental literature and introduces 12 actions that might help to alleviate this credibility crisis and raise experimental economics to an even higher level. In this way, we view our "12 action wish list" as discussion points to enrich the field.
Glenn W Harrison, John A List
Cited by*: 644 Downloads*: 105

Experimental economists are leaving the reservation. They are recruiting subjects in the field rather than in the classroom, using field goods rather than induced valuations, and using field context rather than abstract terminology in instructions. We argue that there is something methodologically fundamental behind this trend. Field experiments differ from laboratory experiments in many ways. Although it is tempting to view field experiments as simply less controlled variants of laboratory experiments, we argue that to do so would be to seriously mischaracterize them. What passes for "control" in laboratory experiments might in fact be precisely the opposite if it is artificial to the subject or context of the task. We propose six factors that can be used to determine the field context of an experiment: the nature of the subject pool, the nature of the information that the subjects bring to the task, the nature of the commodity, the nature of the task or trading rules applied, the nature of the stakes, and the environment that subjects operate in.
Hans P Binswanger
Cited by*: 412 Downloads*: 122

Attitudes toward risk were measures in 240 households using two methods: an interview method eliciting certainty equivalents and an experimental gambling approach with real payoffs which, at their maximum, exceeded monthly incomes of unskilled laborers. The interview method is subject to interviewer bias and its results were totally inconsistent with the experimental measures of risk aversion. Experimental measures indicate that, at high payoff levels, virtually all individuals are moderately risk-averse with little variation according to personal characteristics. Wealth tends to reduce risk aversion slightly, but its effect is not statistically significant.
Glenn W Harrison, Morten I Lau, Elisabet E Rutstrom
Cited by*: 378 Downloads*: 31

We estimate individual risk attitudes using controlled experiments in the field in Denmark. The experiments were carried out across Denmark using a representative sample of 253 people between 19 and 75 years of age. Risk attitudes are estimated for various individuals differentiated by socio-demographic characteristics. Our results indicate that the average Dane is risk averse, and that risk neutrality is an inappropriate assumption to apply. We also find that risk attitudes vary significantly with respect to several important socio-demographic variables such as age and education. However, we do not find any effect of sex on risk attitudes. Copyright The editors of the "Scandinavian Journal of Economics" 2007 .
Raghabendra Chattopadhyay, Esther Duflo
Cited by*: 336 Downloads*: 40

This paper uses political reservations for women in India to study the impact of women's leadership on policy decisions. In 1998, one third of all leadership positions of Village Councils in West Bengal were randomly selected to be reserved for a woman: in these councils only women could be elected to the position of head. Village Councils are responsible for the provision on many local public good in rural areas. Using a data set we collected on 165 Village Councils, we compare the type of public goods provided in reserved and unreserved Villages Councils. We show that women invest more in infrastructure that is directly relevant to the needs of rural women (water, fuel, and roads), while men invest more in education. Women are more likely to participate in the policy-making process if the leader of their village council is a woman.
Steven D Levitt, John A List
Cited by*: 321 Downloads*: 96

A critical question facing experimental economists is whether behavior inside the laboratory is a good indicator of behavior outside the laboratory. To address that question, we build a model in which the choices that individuals make depend not just on financial implications, but also on the nature and extent of scrutiny by others, the particular context in which a decision is embedded, and the manner in which participants and tasks are selected. We present empirical evidence demonstrating the importance of these various factors. To the extent that lab and naturally occurring environments systematically differ on any of these dimensions, the results obtained inside and outside the lab need not correspond. Focusing on experiments designed to measure social preferences, we discuss the extent to which the existing laboratory results generalize to naturally-occurring markets. We summarize cases where the lab may understate the importance of social preferences as well as instances in which the lab might exaggerate their importance. We conclude by emphasizing the importance of interpreting laboratory and field data through the lens of theory.
Esther Duflo, Emmanuel Saez
Cited by*: 320 Downloads*: 30

This paper analyzes a randomized experiment to shed light on the role of information and social interactions in employees' decisions to enroll in a Tax Deferred Account (TDA) retirement plan within a large university. The experiment encouraged a random sample of employees in a subset of departments to attend a benefits information fair organized by the university, by promising a monetary reward for attendance. The experiment multiplied by more than five the attendance rate of these treated individuals (relative to controls), and tripled that of untreated individuals within departments where some individuals were treated. TDA enrollment five and eleven months after the fair was significantly higher in departments where some individuals were treated than in departments where nobody was treated. However, the effect on TDA enrollment is almost as large for individuals in treated departments who did not receive the encouragement as for those who did. We provide three interpretations-differential treatment effects, social network effects, and motivational reward effects-to account for these results.
Shlomo Benartzi, Richard H Thaler
Cited by*: 298 Downloads*: 146

As firms switch from defined-benefit plans to defined-contribution plans, employees bear more responsibility for making decisions about how much to save. The employees who fail to join the plan or who participate at a very low level appear to be saving at less than the predicted life cycle savings rates. Behavioral explanations for this behavior stress bounded rationality and self-control and suggest that at least some of the low-saving households are making a mistake and would welcome aid in making decisions about their saving. In this paper, we propose such a prescriptive savings program, called Save More Tomorrow (hereafter, the SMarT program). The essence of the program is straightforward: people commit in advance to allocating a portion of their future salary increases toward retirement savings. We report evidence on the first three implementations of the SMarT program. Our key findings, from the first implementation, which has been in place for four annual raises, are as follows: (1) a high proportion (78 percent) of those offered the plan joined, (2) the vast majority of those enrolled in the SMarT plan (80 percent) remained in it through the fourth pay raise, and (3) the average saving rates for SMarT program participants increased from 3.5 percent to 13.6 percent over the course of 40 months. The results suggest that behavioral economics can be used to design effective prescriptive programs for important economic decisions.
Uri Gneezy, Aldo Rustichini
Cited by*: 287 Downloads*: 81

The deterrence hypothesis predicts that the introduction of a penalty that leaves everything else unchanged will reduce the occurrence of the behavior subject to the fine. We present the result of a field study in a group of day-care centers that contradicts this prediction. Parents used to arrive late to collect their children, forcing a teacher to stay after closing time. We introduced a monetary fine for late-coming parents. As a result, the number of late-coming parents increased significantly. After the fine was removed no reduction occurred. We argue that penalties are usually introduced into an incomplete contract, social or private. They may change the information that agents have, and therefore the effect on behavior may be opposite of that expected. If this is true, the deterrence hypothesis loses its predictive strength, since the clause "everything else is left unchanged" might be hard to satisfy.
John A List
Cited by*: 262 Downloads*: 100

This study examines individual behavior in two well-functioning marketplaces to investigate whether market experience eliminates the endowment effect. Field evidence from both markets suggests that individual behavior converges to the neoclassical prediction as market experience increases. In an experimental test of whether these observations are due to treatment (market experience) or selection (e.g., static preferences), I find that market experience plays a significant role in eliminating the endowment effect. I also find that these results are robust to institutional change and extend beyond the two marketplaces studied. Overall, this study provides strong evidence that market experience eliminates an important market anomaly.
Uri Gneezy, John A List
Cited by*: 262 Downloads*: 31

Recent discoveries in behavioral economics have led scholars to question the underpinnings of neoclassical economics. We use insights gained from one of the most influential lines of behavioral research -- gift exchange -- in an attempt to maximize worker effort in two quite distinct tasks: data entry for a university library and door-to-door fundraising for a research center. In support of the received literature, our field evidence suggests that worker effort in the first few hours on the job is considerably higher in the "gift" treatment than in the "non-gift treatment." After the initial few hours, however, no difference in outcomes is observed, and overall the gift treatment yielded inferior aggregate outcomes for the employer: with the same budget we would have logged more data for our library and raised more money for our research center by using the market-clearing wage rather than by trying to induce greater effort with a gift of higher wages.