Papers - All
Glenn W Harrison,
John A List
Cited by*: 644 Downloads*: 105 
Experimental economists are leaving the reservation. They are recruiting subjects in the field rather than in the classroom, using field goods rather than induced valuations, and using field context rather than abstract terminology in instructions. We argue that there is something methodologically fundamental behind this trend. Field experiments differ from laboratory experiments in many ways. Although it is tempting to view field experiments as simply less controlled variants of laboratory experiments, we argue that to do so would be to seriously mischaracterize them. What passes for "control" in laboratory experiments might in fact be precisely the opposite if it is artificial to the subject or context of the task. We propose six factors that can be used to determine the field context of an experiment: the nature of the subject pool, the nature of the information that the subjects bring to the task, the nature of the commodity, the nature of the task or trading rules applied, the nature of the stakes, and the environment that subjects operate in.
John A List
Cited by*: 49 Downloads*: 123
Laboratory experiments have been used extensively in economics in the past several decades to lend both positive and normative insights into a myriad of important economic issues. This study discusses a related approach that has increasingly grown in prominence of late--field experiments. I argue that field experiments serve as a useful bridge between data generated in the lab and empirical studies using naturally-occurring data. In discussing this relationship, I highlight that field experiments can yield important insights into economic theory and provide useful guidance to policymakers. I also draw attention to an important methodological contribution of field experiments: they provide an empirical account of behavioral principles that are shared across different domains. In this regard, at odds with conventional wisdom, I argue that representativeness of the environment, rather than representative of the sampled population, is the most crucial variable in determining generalizability of results for a large class of experimental laboratory games.
Glenn W Harrison
Cited by*: 5 Downloads*: 19
If we are to examine the role of "controls" in different experimental settings, it is appropriate that the word be defined carefully. The Oxford English Dictionary (Second Edition) defines the verb "control" in the following manner: "To exercise restraint or direction upon the free action of; to hold sway over, exercise power or authority over; to dominate, command." So the word means something more active and interventionist than is suggested by it's colloquial clinical usage. Control can include such mundane things as ensuring sterile equipment in a chemistry lab, to restrain the free flow of germs and unwanted particles that might contaminate some test.
John A List
Cited by*: None Downloads*: None
Once believed to be an impossibility, field experiments in economics now occupy a central place in the empiricist's quiver. In the past few decades alone field experiments have taken on much greater import in academe, across organizations, as well as for policymakers. But is this emergence simply a fad that will soon return field experiments to obscurity? I argue in this article that there is something fundamental about the emergence of field experiments, as controlling the assignment mechanism in the field provides unparalleled power to both understand the "effects of causes" and the "causes of effects." This knowledge generation then begins to uncover the generalizability and scalability of knowledge. Quite the opposite of a withering tool that will be gone tomorrow, I urge economists to "double down" on this comparative advantage and in doing so I provide four methodological paths which I hope will cement the promise and growth of field experiments in the social sciences.
Rachel Croson,
Jen Shang
Cited by*: 10 Downloads*: 36
We study the effect of social information on the voluntary provision of public goods. Competing theories predict that others[1] contributions might be either substitutes or complements to one's own. We demonstrate a positive social information effect on individual contributions, supporting theories of complementarities. We find the most influential level of social information is drawn from the 90th to 95th percentile of previous contributions. We furthermore find the effect to be significant for new members but not for renewing members. In the most effective condition, social information increases contributions by 12% ($13). These increased contributions do not crowd out future contributions.
Jeff P Carpenter,
Glenn W Harrison,
John A List
Cited by*: 16 Downloads*: 73
No abstract available
Steven D Levitt,
John A List
Cited by*: 58 Downloads*: 52
This study presents an overview of modern field experiments and their usage in economics. Our discussion focuses on three distinct periods of field experimentation that have influenced the economics literature. The first might well be thought of as the dawn of "field" experimentation: the work of Neyman and Fisher, who laid the experimental foundation in the 1920s and 1930s by conceptualizing randomization as an instrument to achieve identification via experimentation with agricultural plots. The second, the large-scale social experiments conducted by government agencies in the mid-twentieth century, moved the exploration from plots of land to groups of individuals. More recently, the nature and range of field experiments has expanded, with a diverse set of controlled experiments being completed outside of the typical laboratory environment. With this growth, the number and types of questions that can be explored using field experiments has grown tremendously. After discussing these three distinct phases, we speculate on the future of field experimental methods, a future that we envision including a strong collaborative effort with outside parties, most importantly private entities.
John A List,
Imran Rasul
Cited by*: 3 Downloads*: 46
We overview the use of field experiments in labor economics. We showcase studies that highlight the central advantages of this methodology, which include: (i) using economic theory to design the null and alternative hypotheses; (ii) engineering exogenous variation in real world economic environments to establish causal relations and learning about the underlying mechanisms; and (iii) engaging in primary data collection and often working closely with practitioners. To highlight the potential for field experiments to inform issues in labor economics, we organize our discussion around the individual life cycle. We therefore consider field experiments related to the accumulation of human capital, the demand and supply of labor, behavior within firms, and close with a brief discussion of the nascent literature of field experiments related to household decision-making.
Omar Al-Ubaydli,
John A List
Cited by*: None Downloads*: None
This is a review of the literature of field experimental studies of markets. The main results covered by the review are as follows: (1) Generally speaking, markets organize the efficient exchange of commodities; (2) There are some behavioral anomalies that impede efficient exchange; (3) Many behavioral anomalies disappear when traders are experienced.
Omar Al-Ubaydli,
John A List
Cited by*: 2 Downloads*: 88
This is a review of the literature of field experimental studies of markets. The main results covered by the review are as follows: (1) Generally speaking, markets organize the efficient exchange of commodities; (2) There are some behavioral anomalies that impede efficient exchange; (3) Many behavioral anomalies disappear when traders are experienced.
John A List,
Robert D Metcalfe
Cited by*: 3 Downloads*: 14
Field experiments represent a relatively new area in economics to understand the causal links from one variable to another. They have been used by academics to help answer interesting and policy-relevant questions in the developed world relating to educational attainment, tax avoidance, consumer finance, negative externalities, charitable giving, and labour market contracts. In this paper we bring together the key ideas behind the different variants of field experiments, how field experiments have been used to test theory, their limitations, and the new areas currently being opened up by field experiments.
Peter A Riach,
Judith Rich
Cited by*: 136 Downloads*: 37
Controlled experiments, using matched pairs of bogus transactors, to test for discrimination in the marketplace have been conducted for over 30 years, and have extended across 10 countries. Significant, persistent and pervasive levels of discrimination have been found against non-whites and women in labour, housing and product markets. Rates of employment discrimination against non-whites, in excess of 25% have been measured in Australia, Europe and North America. A small number of experiments have also investigated employment discrimination against the disabled in Britain and the Netherlands, and against older applicants in the United States.
Jonathan E Alevy,
Craig E Landry,
John A List
Cited by*: 4 Downloads*: 46
A pillar of behavioral research is that preferences are constructed during the process of choice. A prominent finding is that uninformative numerical "anchors" influence judgment and valuation. It remains unclear whether such processes influence market equilibria. We conduct two experiments that extend the study of anchoring to field settings. The first experiment produces evidence that some consumers' valuations can be anchored in novel situations; there is no evidence that experienced agents are influenced by anchors. The second experiment finds that anchors have only transient effects on market outcomes that converge to equilibrium predictions after a few market periods.
James Andreoni,
Michael Kuhn,
John A List,
Anya Samek,
Charles Sprenger
Cited by*: 0 Downloads*: 119
Time preferences have been correlated with a range of life outcomes, yet little is known about their early development. We conduct a field experiment to elicit time preferences of nearly 1,000 children ages 3-12, who make several inter temporal decisions. To shed light on how such primitives form, we explore various channels that might affect time preferences, from background characteristics to the causal impact of an early schooling program that we developed and operated. Our results suggest that time preferences evolve substantially during this period with younger children displaying more impatience than older children. We also find a strong association with race: black children, relative to white or Hispanic children, are more impatient. Interestingly, parents of black children are also much more impatient than parents of white and Hispanic children. Finally, assignment to different schooling opportunities is not significantly associated with child time preferences.
David Lucking-Reiley
Cited by*: 1 Downloads*: 11
I present experimental evidence on the effects of minimum bids in first-price, sealed-bid auctions. The auction experiments manipulated the minimum bids in a preexisting market on the Internet for collectible trading cards from the game Magic: the Gathering. I examine a number of outcomes, including the number of participating bidders, the probability of sale, the levels of individual bids, and the auctioneer's revenues. The benchmark theoretical model is one with symmetric, risk-neutral bidders with independent private values. The results verify a number of the predictions concerning equilibrium bidding. Many bidders behave strategically, anticipating the effects of the reserve price on others' bids.
Wojciech Hardy,
Michal Krawczyk,
Joanna Tyrowicz
Cited by*: None Downloads*: None
In this project, we investigate downloading and sharing behaviour in a novel 'piracy game' modelled after standard public good games. We find that willingness to share correlates positively with the sharing by others. By contrast, actual behaviour in the 'piracy game' is not correlated with self-reported behaviour.
Antoni Bosch-Domenech,
Jose Garcia-Montalvo,
Rosemarie Nagel,
Albert Satorra
Cited by*: 0 Downloads*: 12
This paper develops a finite mixture distribution analysis of Beauty-Contest data obtained from diverse groups of experiments. ML estimation using the EM approach provides estimates for the means and variances of the component distributions, which are common to all the groups, and estimates of the mixing proportions, which are specific to each group. This estimation is performed without imposing constraints on the parameters of the composing distributions. The statistical analysis indicates that many individuals follow a common pattern of reasoning described as iterated best reply (degenerate), and shows that the proportions of people thinking at different levels of depth vary across groups.
Aileen Heinberg,
Angela Hung,
Arie Kapteyn,
Annamaria Lusardi,
Anya Samek,
Joanne Yoong
Cited by*: 2 Downloads*: 3
In this paper, we design and field a low-cost, easily-replicable financial education program called "Five Steps," covering five basic financial planning concepts that relate to retirement. We conduct a field experiment to evaluate the overall impact of "Five Steps" on a probability sample of the American population. In different treatment arms, we quantify the relative impact of delivering the program through video and narrative formats. Our results show that short videos and narratives (each takes about three minutes) have sizable short-run effects on objective measures of respondent knowledge. Moreover, keeping informational content relatively constant, format has significant effects on other psychological levers of behavioral change: effects on motivation and self-efficacy are significantly higher when videos are used, which ultimately influences knowledge acquisition. Follow-up tests of respondents' knowledge approximately eight months after the interventions suggest that between one-quarter and one-third of the knowledge gain and about one-fifth of the self-efficacy gains persist. Thus, this simple program has effects both in the short run and medium run.
Jana Gallus
Cited by*: 0 Downloads*: 28
This natural field experiment tests the effects of purely symbolic awards on volunteer retention in a public goods context. The experiment is conducted at Wikipedia, which faces declining editor retention rates, particularly among newcomers. Randomization assures that award receipt is orthogonal to previous performance. The analysis reveals that awards have a sizeable effect on newcomer retention, which persists over the four quarters following the initial intervention. This is noteworthy for indicating that awards for volunteers can be effective even if they have no impact on the volunteers' future career opportunities. The awards are purely symbolic, and the status increment they produce is limited to the recipients' pseudonymous online identities in a community they have just recently joined. The results can be explained by enhanced self-identification with the community, but they are also in line with recent findings on the role of status and reputation, recognition, and evaluation potential in online communities.
John A List
Cited by*: None Downloads*: None
In 2019 I put together a summary of data from my field experiments website that pertained to framed field experiments. Several people have asked me if I have update. In this document I update all figures and numbers to show the details for 2021. I also include the description from the 2019 paper below.