Search Papers

Glenn W Harrison, John A List

Cited by*: 644 Downloads*: 105

Experimental economists are leaving the reservation. They are recruiting subjects in the field rather than in the classroom, using field goods rather than induced valuations, and using field context rather than abstract terminology in instructions. We argue that there is something methodologically fundamental behind this trend. Field experiments differ from laboratory experiments in many ways. Although it is tempting to view field experiments as simply less controlled variants of laboratory experiments, we argue that to do so would be to seriously mischaracterize them. What passes for "control" in laboratory experiments might in fact be precisely the opposite if it is artificial to the subject or context of the task. We propose six factors that can be used to determine the field context of an experiment: the nature of the subject pool, the nature of the information that the subjects bring to the task, the nature of the commodity, the nature of the task or trading rules applied, the nature of the stakes, and the environment that subjects operate in.

John A List, David H Reiley

Cited by*: 142 Downloads*: 82

Field experiments have grown significantly in prominence over the past decade. In this essay, we provide a summary of the major types of field experiments, explore their uses, and describe a few examples. We show how field experiments can be used for both positive and normative purposes within economics. We also discuss more generally why data collection is useful in science, and more narrowly discuss the question of generalizability. In this regard, we envision field experiments playing a classic role in helping investigators learn about the behavioral principles that are shared across different domains.

Michael S Haigh, John A List

Cited by*: 10 Downloads*: 15

We compare behavior across students and professional traders from the Chicago Board of Trade in a classic Allais paradox experiment. Our experiment tests whether independence, a necessary condition in expected utility theory, is systematically violated. We find that both students and professionals exhibit some behavior consistent with the Allais paradox, but the data pattern does suggest that the trader population falls prey to the Allais paradox less frequently than the student population.

Richard Engelbrecht-Wiggans, John A List, David H Reiley

Cited by*: 1 Downloads*: 4

My coauthors and I reply to the comments of Daniel Levin on our paper "Demand Reduction in Multiunit Auctions: Evidence from a Sportscard Field Experiment." In his comment, Levin presents new theory and proposes a new equilibrium to explain annomalies reported in our earlier sportscard auction, such as higher first-unit bids under the uniform-price institution. We evaluate his theory and equilibrium in the context of both uniform-price and Vickrey auctions and point out our concerns. Where possible, we attempt to test the predictions of his theory with our existing data.

David H Herberich, John A List

Cited by*: 9 Downloads*: 42

The article reports on a study that provides understanding of how risk preferences and other factors influence a farmer's decision to participate in a carbon offset market. It states incorporating background risk in a laboratory setting and drawing subjects from both a standard student population and a nonstandard farmer population helped to understand the decision making process. The study suggests that farmers are slightly more risk averse than students.

John A List, Jason F Shogren

Cited by*: 19 Downloads*: 20

This paper calibrates real and hypothetical willingness-to-accept estimates elicited for consumer goods in a multi-unit, random nth-price auction. Using a within-subject experimental design, we find that people understated their real willingness to accept in the hypothetical regimes, framed both as demand and non-demand revealing. After controlling for personspecific effects, however, hypothetical and real statements are equivalent on the margin.

Dean S Karlan, John A List

Cited by*: 37 Downloads*: 17

We conducted a natural field experiment to explore the effect of price changes on charitable contributions. To operationalize our tests, we examine whether an offer to match contributions to a non-profit organization changes the likelihood and amount that an individual donates. Direct mail solicitations were sent to over 50,000 prior donors. We find that the match offer increases both the revenue per solicitation and the probability that an individual donates. While comparisons of the match treatments and the control group consistently reveal this pattern, larger match ratios (i.e., $3:$1 and $2:$1) relative to smaller match ratios ($1:$1) had no additional impact. The results have clear implications for practitioners in the design of fundraising campaigns and provide avenues for future empirical and theoretical work on charitable giving. Further, the data provide an interesting test of important methods used in cost-benefit analysis.

John A List, David Lucking-Reiley

Cited by*: 161 Downloads*: 25

We test two recent theories on the subject of charitable fundraising in capital campaigns. Andreoni (1998) predicts that publicly announced seed contributions can increase the total amount of charitable giving in a capital campaign. Bagnoli and Lipman (1989) predict that another technique for increasing contributions is a promise to refund donors' money in case the campaign threshold is not reached. Using a field experiment in a capital campaign for the Center for Environmental Policy Analysis at the University of Central Florida, we present evidence on both of these predictions. Data from direct mail solicitations sent to 3000 Central Floridian residents confirm the basic comparative-static predictions of both theories: total contributions increase with the amount of seed money, and with the use of a refund policy. A change in seed money from 10% to 67% of the campaign goal resulted in nearly a sixfold increase in contributions, while imposing a refund increased contributions by a more modest 20%. Seed money has a statistically significant effect on both the proportion of people choosing to donate and on the average gift size of those who donate, while refunds have a statistically significant effect only on the average gift size. These results have clear implications for practitioners in the design of fundraising campaigns.

Greer K Gosnell, John A List, Robert D Metcalfe

Cited by*: 8 Downloads*: 42

Understanding motivations in the workplace remains of utmost import as economies around the world rely on increases in labor productivity to foster sustainable economic growth. This study makes use of a unique opportunity to "look under the hood" of an organization that critically relies on worker effort and performance. By partnering with Virgin Atlantic Airways on a field experiment that includes over 40,000 unique flights covering an eight-month period, we explore how information and incentives affect captains' performance. Making use of more than 110,000 captain-level observations, we find that our set of treatments-which include performance information, personal targets, and prosocial incentives-induces captains to improve efficiency in all three key flight areas: pre-flight, in-flight, and post-flight. We estimate that our treatments saved between 266,000-704,000 kg of fuel for the airline over the eight-month experimental period. These savings led to between 838,000-2.22 million kg of CO2 abated at a marginal abatement cost of negative $250 per ton of CO2 (i.e. a $250 savings per ton abated) over the eight-month experimental period. Methodologically, our approach highlights the potential usefulness of moving beyond an experimental design that focuses on short-run substitution effects, and it also suggests a new way to combat firm-level externalities: target workers rather than the firm as a whole.

Omar Al-Ubaydli, John A List

Cited by*: 2 Downloads*: 1

Economists are increasingly turning to the experimental method as a means to estimate causal effects. By using randomization to identify key treatment effects, theories previously viewed as untestable are now scrutinized, efficacy of public policies are now more easily verified, and stakeholders can swiftly add empirical evidence to aid their decision-making. This study provides an overview of experimental methods in economics, with a special focus on developing an economic theory of generalizability. Given that field experiments are in their infancy, our secondary focus pertains to a discussion of the various parameters that they identify, and how they add to scientific knowledge. We conclude that until we conduct more field experiments that build a bridge between the lab and the naturally-occurring settings of interest we cannot begin to make strong conclusions empirically on the crucial question of generalizability from the lab to the field.

John A List, Daniel L Millimet, Thanasis Stengos

Cited by*: 32 Downloads*: 1

We explore the importance of modeling strategies when estimating the emissions-income relationship. Using U.S. state-level panel data on nitrogen oxide and sulfur dioxide emissions, we estimate several environmental Kuznets curves using the standard parametric framework as well as a more flexible semiparametric alternative. Formal statistical comparisons of the results overwhelmingly reject the parametric approach. Moreover, the differences, particularly for sulfur dioxide, are economically significant.

John A List, Daniel L Millimet

Cited by*: 3 Downloads*: 6

Devolution of tasks to local levels of government has recently become a popular agenda item within certain political factions in the US. While one expects the local policymaker to tailor policies to match the preferences of his constituents, critics of local policymaking claim that externalities are ignored and inefficiencies thus arise under local control of certain policies. A primary example concerns the control of pollution, which is known to have adverse effects on neighbouring jurisdictions. Whether localities actually 'race to the bottom' and enact lax environmental policies when given the chance remains an open issue. In this study, we make use of stochastic dominance tests to examine if President Reagan's policy of 'New Federalism' in the early 1980s induced states to lower environmental standards. Among the several environmental measures analysed, we do not find any evidence that the 'race to the bottom' materialized. Indeed, the evidence shows that even during these lean years of federal intervention several indicators of environmental quality at the state level continued to improve.

John A List, Jason F Shogren

Cited by*: 9 Downloads*: 8

n/a

Stefano DellaVigna, John A List, Ulrike Malmendier, Gautam Rao

Cited by*: 13 Downloads*: 66

We design a model-based field experiment to estimate the nature and magnitude of workers' social preferences towards their employers. We hire 446 workers for a one-time task. Within worker, we vary (i) piece rates; (ii) whether the work has payoffs only for the worker, or also for the employer; and (iii) the return to the employer. We then introduce a surprise increase or decrease in pay ('gifts') from the employer. We find that workers have substantial baseline social preferences towards their employers, even in the absence of repeated-game incentives. Consistent with models of warm glow or social norms, but not of pure altruism, workers exert substantially more effort when their work is consequential to their employer, but are insensitive to the precise return to the employer. Turning to reciprocity, we find little evidence of a response to unexpected positive (or negative) gifts from the employer. Our structural estimates of the social preferences suggest that, if anything, positive reciprocity in response to monetary 'gifts' may be larger than negative reciprocity. We revisit the results of previous field experiments on gift exchange using our model and derive a one-parameter expression for the implied reciprocity in these experiments.

Steffen Andersen, Seda Ertac, Uri Gneezy, John A List, Sandra Maximiano

Cited by*: 35 Downloads*: 2

Recent literature presents evidence that men are more competitively inclined than women. Since top-level careers usually require competitiveness, competitiveness differences provide an explanation for gender gaps in wages and differences in occupational choice. A natural question is whether women are born less competitive or whether they become so through the process of socialization. To pinpoint when in the socialization process the difference arises, we compare the competitiveness of children in matrilineal and patriarchal societies. We find that while there is no difference at any age in the matrilineal society, girls become less competitive around puberty in the patriarchal society.

Eszter Czibor, David Jimenez-Gomez, John A List

Cited by*: None Downloads*: None

What was once broadly viewed as an impossibility - learning from experimental data in economics - has now become commonplace. Governmental bodies, think tanks, and corporations around the world employ teams of experimental researchers to answer their most pressing questions. For their part, in the past two decades academics have begun to more actively partner with organizations to generate data via field experimentation. While this revolution in evidence-based approaches has served to deepen the economic science, recently a credibility crisis has caused even the most ardent experimental proponents to pause. This study takes a step back from the burgeoning experimental literature and introduces 12 actions that might help to alleviate this credibility crisis and raise experimental economics to an even higher level. In this way, we view our "12 action wish list" as discussion points to enrich the field.

Yan Chen, Peter Cramton, John A List, Axel Ockenfels

Cited by*: None Downloads*: None

We review past research and discuss future directions on how the vibrant research areas of market design and behavioral economics have influenced and will continue to impact the science and practice of management in both the private and public sectors. Using examples from various auction markets, reputation and feedback systems in online markets, matching markets in education, and labor markets, we demonstrate that combining market design theory, behavioral insights, and experimental methods can lead to fruitful implementation of superior market designs in practice.

Chien-Yu Lai, John A List, Anya Samek

Cited by*: None Downloads*: None

The National School Lunch Program (NSLP) is a federal food assistance program that serves over 30 million children in the United States annually. Yet the impact of NSLP on nutritional intake may be limited because children frequently do not choose the healthier offerings or waste large portions of their meal. In this article, we study whether we can improve the impact of the NSLP on child food choice through low-cost nudges. We conduct a field experiment in a school lunchroom with 2500 children, evaluating the impact of informational prompts on milk choice and consumption over two weeks. We find that the prompts alone increase the proportion of children choosing and consuming the healthier white milk relative to sugar-sweetened chocolate milk from 20% in the control group to 30% in the treatment groups. Adding health or taste messaging to the prompt does not seem to make a difference. We survey students and find that most prompts affect perceived healthfulness of the milk, but not perceived taste. Finally, we find that the prompts are nearly as effective as a small nonmonetary incentive.

Marco Castillo, John A List, Ragan Petrie, Anya Samek

Cited by*: None Downloads*: None

We use field experiments with nearly 900 children to investigate how skills developed at ages 3-5 drive later-life outcomes. We find that skills map onto three distinct factors - cognitive skills, executive functions, and economic preferences. Returning to the children up to 7 years later, we find that executive functions, but not cognitive skills, predict the likelihood of receiving disciplinary referrals. Economic preferences have an independent effect: children who displayed impatience at ages 3-5 were more likely to receive disciplinary referrals. Random assignment to a parenting program reduced disciplinary referrals. This effect was not mediated by skills or preferences.

Omar Al-Ubaydli, John A. List

Cited by*: None Downloads*: None

The A/B testing approach invites promising early results that are unlikely to be realized in a larger setting. We argue that within the social sciences, a fundamentally different approach is needed; we call it option C thinking. Put simply, a twenty-first-century team of civil servants and social scientists should lead with experiments that anticipate likely causes of failure at scale, even if doing so requires more time, effort, and resources initially.