Snigdha Gupta, John A List, Lauren Supplee, Dana L Suskind
Cited by*: None Downloads*: None

Failed to Scale: Embracing the Challenge of Scaling in Early Childhood
Werner Guth, Carsten Schmidt, Matthias Sutter
Cited by*: 21 Downloads*: 21

On 11 May 2001, readers of the Berliner Zeitung were invited to participate in an ultimatum bargaining experiment played in the strategy vector mode: each participant chooses not only how much (s)he demands of the DM1,000 pie but also which of the nine possible offers of DM100, 200, ..., 900 (s)he would accept or reject. In addition, participants were asked to predict the most frequent type of behavior. Three randomly selected proposer-responder pairs were rewarded according to the rules of ultimatum bargaining and three randomly chosen participants of those who predicted the most frequent type of behavior received a prize of DM500. Decisions could be submitted by mail, fax or via the internet. Behavior is described, statistically analyzed and compared to the usual laboratory ultimatum bargaining results.
Erwin Bulte, Simon Levin , John A List, Steven Pacala
Cited by*: 1 Downloads*: 2

n/a
Amanda Chuan, Anya Samek
Cited by*: 0 Downloads*: 4

We conducted a field experiment with a charitable group to investigate whether giving the donor an option to write a personal message to the recipient influences giving behavior. Over 1,500 households were approached in a door-to-door campaign and randomized to either a control or a treatment in which donors could include a card for the recipient. We predict that treatment should increase contributions through making the gift more meaningful, but may also decrease contribution rate by increasing the social or other cost of donating. We find evidence in favor of the cost effect, and no evidence of increased giving.
John A List, David H Reiley
Cited by*: 142 Downloads*: 82

Field experiments have grown significantly in prominence over the past decade. In this essay, we provide a summary of the major types of field experiments, explore their uses, and describe a few examples. We show how field experiments can be used for both positive and normative purposes within economics. We also discuss more generally why data collection is useful in science, and more narrowly discuss the question of generalizability. In this regard, we envision field experiments playing a classic role in helping investigators learn about the behavioral principles that are shared across different domains.
Glenn W Harrison, John A List
Cited by*: 644 Downloads*: 105

Experimental economists are leaving the reservation. They are recruiting subjects in the field rather than in the classroom, using field goods rather than induced valuations, and using field context rather than abstract terminology in instructions. We argue that there is something methodologically fundamental behind this trend. Field experiments differ from laboratory experiments in many ways. Although it is tempting to view field experiments as simply less controlled variants of laboratory experiments, we argue that to do so would be to seriously mischaracterize them. What passes for "control" in laboratory experiments might in fact be precisely the opposite if it is artificial to the subject or context of the task. We propose six factors that can be used to determine the field context of an experiment: the nature of the subject pool, the nature of the information that the subjects bring to the task, the nature of the commodity, the nature of the task or trading rules applied, the nature of the stakes, and the environment that subjects operate in.
John A List
Cited by*: 49 Downloads*: 123

Laboratory experiments have been used extensively in economics in the past several decades to lend both positive and normative insights into a myriad of important economic issues. This study discusses a related approach that has increasingly grown in prominence of late--field experiments. I argue that field experiments serve as a useful bridge between data generated in the lab and empirical studies using naturally-occurring data. In discussing this relationship, I highlight that field experiments can yield important insights into economic theory and provide useful guidance to policymakers. I also draw attention to an important methodological contribution of field experiments: they provide an empirical account of behavioral principles that are shared across different domains. In this regard, at odds with conventional wisdom, I argue that representativeness of the environment, rather than representative of the sampled population, is the most crucial variable in determining generalizability of results for a large class of experimental laboratory games.
Glenn W Harrison
Cited by*: 5 Downloads*: 19

If we are to examine the role of "controls" in different experimental settings, it is appropriate that the word be defined carefully. The Oxford English Dictionary (Second Edition) defines the verb "control" in the following manner: "To exercise restraint or direction upon the free action of; to hold sway over, exercise power or authority over; to dominate, command." So the word means something more active and interventionist than is suggested by it's colloquial clinical usage. Control can include such mundane things as ensuring sterile equipment in a chemistry lab, to restrain the free flow of germs and unwanted particles that might contaminate some test.
John A List
Cited by*: None Downloads*: None

Once believed to be an impossibility, field experiments in economics now occupy a central place in the empiricist's quiver. In the past few decades alone field experiments have taken on much greater import in academe, across organizations, as well as for policymakers. But is this emergence simply a fad that will soon return field experiments to obscurity? I argue in this article that there is something fundamental about the emergence of field experiments, as controlling the assignment mechanism in the field provides unparalleled power to both understand the "effects of causes" and the "causes of effects." This knowledge generation then begins to uncover the generalizability and scalability of knowledge. Quite the opposite of a withering tool that will be gone tomorrow, I urge economists to "double down" on this comparative advantage and in doing so I provide four methodological paths which I hope will cement the promise and growth of field experiments in the social sciences.
Rachel Croson, Jen Shang
Cited by*: 10 Downloads*: 36

We study the effect of social information on the voluntary provision of public goods. Competing theories predict that others[1] contributions might be either substitutes or complements to one's own. We demonstrate a positive social information effect on individual contributions, supporting theories of complementarities. We find the most influential level of social information is drawn from the 90th to 95th percentile of previous contributions. We furthermore find the effect to be significant for new members but not for renewing members. In the most effective condition, social information increases contributions by 12% ($13). These increased contributions do not crowd out future contributions.
Jeff P Carpenter, Glenn W Harrison, John A List
Cited by*: 16 Downloads*: 73

No abstract available
Steven D Levitt, John A List
Cited by*: 58 Downloads*: 52

This study presents an overview of modern field experiments and their usage in economics. Our discussion focuses on three distinct periods of field experimentation that have influenced the economics literature. The first might well be thought of as the dawn of "field" experimentation: the work of Neyman and Fisher, who laid the experimental foundation in the 1920s and 1930s by conceptualizing randomization as an instrument to achieve identification via experimentation with agricultural plots. The second, the large-scale social experiments conducted by government agencies in the mid-twentieth century, moved the exploration from plots of land to groups of individuals. More recently, the nature and range of field experiments has expanded, with a diverse set of controlled experiments being completed outside of the typical laboratory environment. With this growth, the number and types of questions that can be explored using field experiments has grown tremendously. After discussing these three distinct phases, we speculate on the future of field experimental methods, a future that we envision including a strong collaborative effort with outside parties, most importantly private entities.
John A List, Imran Rasul
Cited by*: 3 Downloads*: 46

We overview the use of field experiments in labor economics. We showcase studies that highlight the central advantages of this methodology, which include: (i) using economic theory to design the null and alternative hypotheses; (ii) engineering exogenous variation in real world economic environments to establish causal relations and learning about the underlying mechanisms; and (iii) engaging in primary data collection and often working closely with practitioners. To highlight the potential for field experiments to inform issues in labor economics, we organize our discussion around the individual life cycle. We therefore consider field experiments related to the accumulation of human capital, the demand and supply of labor, behavior within firms, and close with a brief discussion of the nascent literature of field experiments related to household decision-making.
Omar Al-Ubaydli, John A List
Cited by*: None Downloads*: None

This is a review of the literature of field experimental studies of markets. The main results covered by the review are as follows: (1) Generally speaking, markets organize the efficient exchange of commodities; (2) There are some behavioral anomalies that impede efficient exchange; (3) Many behavioral anomalies disappear when traders are experienced.
Omar Al-Ubaydli, John A List
Cited by*: 2 Downloads*: 88

This is a review of the literature of field experimental studies of markets. The main results covered by the review are as follows: (1) Generally speaking, markets organize the efficient exchange of commodities; (2) There are some behavioral anomalies that impede efficient exchange; (3) Many behavioral anomalies disappear when traders are experienced.
John A List, Robert D Metcalfe
Cited by*: 3 Downloads*: 14

Field experiments represent a relatively new area in economics to understand the causal links from one variable to another. They have been used by academics to help answer interesting and policy-relevant questions in the developed world relating to educational attainment, tax avoidance, consumer finance, negative externalities, charitable giving, and labour market contracts. In this paper we bring together the key ideas behind the different variants of field experiments, how field experiments have been used to test theory, their limitations, and the new areas currently being opened up by field experiments.
Peter A Riach, Judith Rich
Cited by*: 136 Downloads*: 37

Controlled experiments, using matched pairs of bogus transactors, to test for discrimination in the marketplace have been conducted for over 30 years, and have extended across 10 countries. Significant, persistent and pervasive levels of discrimination have been found against non-whites and women in labour, housing and product markets. Rates of employment discrimination against non-whites, in excess of 25% have been measured in Australia, Europe and North America. A small number of experiments have also investigated employment discrimination against the disabled in Britain and the Netherlands, and against older applicants in the United States.
Jonathan E Alevy, Craig E Landry, John A List
Cited by*: 4 Downloads*: 46

A pillar of behavioral research is that preferences are constructed during the process of choice. A prominent finding is that uninformative numerical "anchors" influence judgment and valuation. It remains unclear whether such processes influence market equilibria. We conduct two experiments that extend the study of anchoring to field settings. The first experiment produces evidence that some consumers' valuations can be anchored in novel situations; there is no evidence that experienced agents are influenced by anchors. The second experiment finds that anchors have only transient effects on market outcomes that converge to equilibrium predictions after a few market periods.
James Andreoni, Michael Kuhn, John A List, Anya Samek, Charles Sprenger
Cited by*: 0 Downloads*: 119

Time preferences have been correlated with a range of life outcomes, yet little is known about their early development. We conduct a field experiment to elicit time preferences of nearly 1,000 children ages 3-12, who make several inter temporal decisions. To shed light on how such primitives form, we explore various channels that might affect time preferences, from background characteristics to the causal impact of an early schooling program that we developed and operated. Our results suggest that time preferences evolve substantially during this period with younger children displaying more impatience than older children. We also find a strong association with race: black children, relative to white or Hispanic children, are more impatient. Interestingly, parents of black children are also much more impatient than parents of white and Hispanic children. Finally, assignment to different schooling opportunities is not significantly associated with child time preferences.
David Lucking-Reiley
Cited by*: 1 Downloads*: 11

I present experimental evidence on the effects of minimum bids in first-price, sealed-bid auctions. The auction experiments manipulated the minimum bids in a preexisting market on the Internet for collectible trading cards from the game Magic: the Gathering. I examine a number of outcomes, including the number of participating bidders, the probability of sale, the levels of individual bids, and the auctioneer's revenues. The benchmark theoretical model is one with symmetric, risk-neutral bidders with independent private values. The results verify a number of the predictions concerning equilibrium bidding. Many bidders behave strategically, anticipating the effects of the reserve price on others' bids.