John A List, Charles F Mason
Cited by*: 0 Downloads*: 20

Are individuals expected utility maximizers? This question represents much more than academic curiosity. In a normative sense, at stake are the fundamental underpinnings of the bulk of the last half-century's models of choice under uncertainty. From a positive perspective, the ubiquitous use of benefit-cost analysis across government agencies renders the expected utility maximization paradigm literally the only game in town. In this study, we advance the literature by exploring CEO's preferences over small probability, high loss lotteries. Using undergraduate students as our experimental control group, we find that both our CEO and student subject pools exhibit frequent and large departures from expected utility theory. In addition, as the extreme payoffs become more likely CEOs exhibit greater aversion to risk. Our results suggest that use of the expected utility paradigm in decision making substantially underestimates society's willingness to pay to reduce risk in small probability, high loss events.
John A List, Imran Rasul
Cited by*: 3 Downloads*: 46

We overview the use of field experiments in labor economics. We showcase studies that highlight the central advantages of this methodology, which include: (i) using economic theory to design the null and alternative hypotheses; (ii) engineering exogenous variation in real world economic environments to establish causal relations and learning about the underlying mechanisms; and (iii) engaging in primary data collection and often working closely with practitioners. To highlight the potential for field experiments to inform issues in labor economics, we organize our discussion around the individual life cycle. We therefore consider field experiments related to the accumulation of human capital, the demand and supply of labor, behavior within firms, and close with a brief discussion of the nascent literature of field experiments related to household decision-making.
Craig E Landry, John A List
Cited by*: 35 Downloads*: 17

While contingent valuation remains the only option available for measurement of total economic value of nonmarketed goods, the method has been criticized due to its hypothetical nature. We analyze field experimental data to evaluate two ex ante approaches to attenuating hypothetical bias, directly comparing value statements across four distinct referenda: hypothetical, "cheap talk," "consequential," and real. Our empirical evidence suggests two major findings: hypothetical responses are significantly different from real responses; and responses in the consequential and cheap talk treatments are statistically indistinguishable from real responses. We review the potential for each method to produce reliable results in the field.
Andreas Leibbrandt, John A List
Cited by*: 7 Downloads*: 74

One explanation advanced for the persistent gender pay differences in labor markets is that women avoid salary negotiations. By using a natural field experiment that randomizes nearly 2,500 job-seekers into jobs that vary important details of the labor contract, we are able to observe both the nature of sorting and the extent of salary negotiations. We observe interesting data patterns. For example, we find that when there is no explicit statement that wages are negotiable, men are more likely to negotiate than women. However, when we explicitly mention the possibility that wages are negotiable, this difference disappears, and even tends to reverse. In terms of sorting, we find that men in contrast to women prefer job environments where the 'rules of wage determination' are ambiguous. This leads to the gender gap being much more pronounced in jobs that leave negotiation of wage ambiguous.
Uri Gneezy, John A List
Cited by*: 262 Downloads*: 31

Recent discoveries in behavioral economics have led scholars to question the underpinnings of neoclassical economics. We use insights gained from one of the most influential lines of behavioral research -- gift exchange -- in an attempt to maximize worker effort in two quite distinct tasks: data entry for a university library and door-to-door fundraising for a research center. In support of the received literature, our field evidence suggests that worker effort in the first few hours on the job is considerably higher in the "gift" treatment than in the "non-gift treatment." After the initial few hours, however, no difference in outcomes is observed, and overall the gift treatment yielded inferior aggregate outcomes for the employer: with the same budget we would have logged more data for our library and raised more money for our research center by using the market-clearing wage rather than by trying to induce greater effort with a gift of higher wages.
John A List, Jason F Shogren
Cited by*: 78 Downloads*: 21

We design and implement a field experiment to elicit and calibrate in-sample hypothetical and actual bids given the presence of other goods and intensity of market experience. Using market goods that possess characteristics beyond the norm but yet remain deliverable, bidding behavior was consistent with theory. But we also observe the average calibration factor for hypothetical bids in the auction with other goods to be more severe (0.3) than for the auction without the goods (0.4). The results support the view that the calibration of hypothetical and actual bidding is good- and context-specific.
John A List, Robert D Metcalfe
Cited by*: 3 Downloads*: 14

Field experiments represent a relatively new area in economics to understand the causal links from one variable to another. They have been used by academics to help answer interesting and policy-relevant questions in the developed world relating to educational attainment, tax avoidance, consumer finance, negative externalities, charitable giving, and labour market contracts. In this paper we bring together the key ideas behind the different variants of field experiments, how field experiments have been used to test theory, their limitations, and the new areas currently being opened up by field experiments.
Eric Floyd, John A List
Cited by*: 2 Downloads*: 49

The gold standard in the sciences is uncovering causal relationships. A growing literature in economics utilizes field experiments as a methodology to establish causality between variables. Taking lessons from the economics literature, this study provides an "A-to-Z" description of how to conduct field experiments in accounting and finance. We begin by providing a user's guide into what a field experiment is, what behavioral parameters field experiments identify, and how to efficiently generate and analyze experimental data. We then provide a discussion of extant field experiments that touch on important issues in accounting and finance, and we also review areas that have ample opportunities for future field experimental explorations. We conclude that the time is ripe for field experimentation to deepen our understanding of important issues in accounting and finance.
John A List, Anya Samek
Cited by*: 2 Downloads*: 14

Almost a third of US children ages 2-19 are deemed overweight or obese, and part of the problem is the habitual decision to consume high calorie, low nutrient foods. We propose that the school lunchroom provides a 'teachable moment' to engage children in making healthful choices. We conduct a field experiment with over 1,500 participants in grades K-8 and evaluate the impact of small non-monetary incentives on the selection of milk in the school lunchroom. At baseline, only 16% of children select white milk relative to 84% choosing chocolate milk. We find a significant effect of incentives, which increase white milk selection by 2.5 times, to 40%. One concern with incentives is that they may decrease intrinsic motivation to eat healthy, called 'crowd-out of intrinsic motivation.' However, we do not find evidence of 'crowd-out'; rather, we see some suggestive evidence of the positive habit forming effect of incentives.
John A List, Michael K Price
Cited by*: 3 Downloads*: 6

This study showcases the usefulness of field experiments to the study of environmental and resource economics. Our focus pertains to work related to field experiments in the area of 'behavioral' environmental and resource economics. Within this rubric, we discuss research in two areas: those that inform i) benefit cost analysis and ii) conservation of resources. Within each realm, we show how field experiments have been able to test the relevant theories, provide important parameters to construct new theories, and guide policymakers. We conclude with thoughts on how field experiments can be used to deepen our understanding of important areas within environmental and resource economics.
Ori Heffetz , John A List
Cited by*: 1 Downloads*: 14

A hallmark result within behavioral economics is that individuals' choices are affected by current endowments. A recent theory due to Koszegi and Rabin (2006) explains such endowment effect with a model of expectations-based reference-dependent preferences. Departing from past work, we conduct complementary experiments to disentangle expectations - verified probabilistic beliefs held by subjects - from other features of endowment - such as "assignment" to a good - hence allowing us to compare the effect of expectations with that of other variations. While mere assignment can affect choices, we do not find a large role in the effect for Koszegi-Rabin expectations.
James Edwards, John A List
Cited by*: 1 Downloads*: 0

People respond to those who ask. Within the charitable fundraising community, the power of the ask represents the backbone of most fundraising strategies. Despite this, the optimal design of communication strategies has received less formal attention. For their part, economists have recently explored how communication affects empathy, altruism, and giving rates to charities. Our study takes a step back from this literature to examine how suggestions-a direct ask for a certain amount of money-affect giving rates. We find that our suggestion amounts affect both the intensive and extensive margins: more people give and they tend to give the suggested amount. Resulting insights help us understand why people give, why messages work, and deepen practitioners' understanding of how to use messages to leverage more giving.
Omar Al-Ubaydli, John A List
Cited by*: 2 Downloads*: 88

This is a review of the literature of field experimental studies of markets. The main results covered by the review are as follows: (1) Generally speaking, markets organize the efficient exchange of commodities; (2) There are some behavioral anomalies that impede efficient exchange; (3) Many behavioral anomalies disappear when traders are experienced.
John A List, Yana Peysakhovichc
Cited by*: 1 Downloads*: 5

This paper examines aggregate time series data on individual charitable donations from 1968 to 2007. We find that changes in individual giving show an asymmetric response to changes in the S&P 500: individuals are more responsive to stock market upturns than downturns.
John A List, Daniel L Millimet
Cited by*: 11 Downloads*: 4

One particularly vexing puzzle for economists and policymakers over the past several decades concerns the empirical significance of the theoretically predicted pollution haven hypothesis. While neoclassical theory and conventional wisdom both surmise that local economies will suffer deleterious effects from stricter environmental regulations, empirical studies have largely failed to validate such claims. This study utilizes the method of matching to show that the impact of stricter regulation is heterogeneous spatially, varying systematically based on location-specific attributes. Previous studies that assume a homogenous response may therefore inadvertently mask the overall impact of more stringent regulations by pooling unaffected and affected regions.
Todd Cherry, John A List
Cited by*: 7 Downloads*: 3

This paper uses county-level panel data to test the appropriateness of the 'one size fits all' reduced-form regression approach commonly used when estimating the economic model of crime. Empirical results provide initial evidence that previous studies, which restrict deterrent effects to have identical impacts across crime types, may be presenting statistically biased results.
Luigi Butera, John A List
Cited by*: 1 Downloads*: 355

Novel empirical insights by their very nature tend to be unanticipated, and in some cases at odds with the current state of knowledge on the topic. The mechanics of statistical inference suggest that such initial findings, even when robust and statistically significant within the study, should not appreciably move priors about the phenomenon under investigation. Yet, a few well-conceived independent replications dramatically improve the reliability of novel findings. Nevertheless, the incentives to replicate are seldom in place in the sciences, especially within the social sciences. We propose a simple incentive-compatible mechanism to promote replications, and use experimental economics to highlight our approach. We begin by reporting results from an experiment in which we investigate how cooperation in allocation games is affected by the presence of Knightian uncertainty (ambiguity), a pervasive and yet unexplored characteristic of most public goods. Unexpectedly, we find that adding uncertainty enhances cooperation. This surprising result serves as a test case for our mechanism: instead of sending this paper to a peer-reviewed journal, we make it available online as a working paper, but we commit never to submit it to a journal for publication. We instead offered co-authorship for a second, yet to be written, paper to other scholars willing to independently replicate our study. That second paper will reference this working paper, will include all replications, and will be submitted to a peer- reviewed journal for publication. Our mechanism allows mutually-beneficial gains from trade between the original investigators and other scholars, alleviates the publication bias problem that often surrounds novel experimental results, and accelerates the advancement of economic science by leveraging the mechanics of statistical inference.
Ori Heffetz, John A List
Cited by*: None Downloads*: None

Carefully designed scientific experiments have been an engine of economic, technological, and social progress for well over a century, which is why the public generally trusts such methods. Unfortunately, governments around the world still routinely oppose controlled trials of public policies.
John A. List
Cited by*: Downloads*:

In 2019 I put together a summary of data from my field experiments website that pertained to framed field experiments (see List 2024; 2025). Several people have asked me if I have an update. In this document I update all figures and numbers to show the details for 2024. I also include the description from the 2019 paper below.
John A. List
Cited by*: Downloads*:

A discussion on how ChatGPT can be used to help design experiments that can be scaled.