Glenn W Harrison, John A List
Cited by*: 644 Downloads*: 105

Experimental economists are leaving the reservation. They are recruiting subjects in the field rather than in the classroom, using field goods rather than induced valuations, and using field context rather than abstract terminology in instructions. We argue that there is something methodologically fundamental behind this trend. Field experiments differ from laboratory experiments in many ways. Although it is tempting to view field experiments as simply less controlled variants of laboratory experiments, we argue that to do so would be to seriously mischaracterize them. What passes for "control" in laboratory experiments might in fact be precisely the opposite if it is artificial to the subject or context of the task. We propose six factors that can be used to determine the field context of an experiment: the nature of the subject pool, the nature of the information that the subjects bring to the task, the nature of the commodity, the nature of the task or trading rules applied, the nature of the stakes, and the environment that subjects operate in.
John A List, David H Reiley
Cited by*: 142 Downloads*: 82

Field experiments have grown significantly in prominence over the past decade. In this essay, we provide a summary of the major types of field experiments, explore their uses, and describe a few examples. We show how field experiments can be used for both positive and normative purposes within economics. We also discuss more generally why data collection is useful in science, and more narrowly discuss the question of generalizability. In this regard, we envision field experiments playing a classic role in helping investigators learn about the behavioral principles that are shared across different domains.
Michael S Haigh, John A List
Cited by*: 10 Downloads*: 15

We compare behavior across students and professional traders from the Chicago Board of Trade in a classic Allais paradox experiment. Our experiment tests whether independence, a necessary condition in expected utility theory, is systematically violated. We find that both students and professionals exhibit some behavior consistent with the Allais paradox, but the data pattern does suggest that the trader population falls prey to the Allais paradox less frequently than the student population.
David H Herberich, John A List
Cited by*: 9 Downloads*: 42

The article reports on a study that provides understanding of how risk preferences and other factors influence a farmer's decision to participate in a carbon offset market. It states incorporating background risk in a laboratory setting and drawing subjects from both a standard student population and a nonstandard farmer population helped to understand the decision making process. The study suggests that farmers are slightly more risk averse than students.
John A List, Jason F Shogren
Cited by*: 19 Downloads*: 20

This paper calibrates real and hypothetical willingness-to-accept estimates elicited for consumer goods in a multi-unit, random nth-price auction. Using a within-subject experimental design, we find that people understated their real willingness to accept in the hypothetical regimes, framed both as demand and non-demand revealing. After controlling for personspecific effects, however, hypothetical and real statements are equivalent on the margin.
Dean S Karlan, John A List
Cited by*: 37 Downloads*: 17

We conducted a natural field experiment to explore the effect of price changes on charitable contributions. To operationalize our tests, we examine whether an offer to match contributions to a non-profit organization changes the likelihood and amount that an individual donates. Direct mail solicitations were sent to over 50,000 prior donors. We find that the match offer increases both the revenue per solicitation and the probability that an individual donates. While comparisons of the match treatments and the control group consistently reveal this pattern, larger match ratios (i.e., $3:$1 and $2:$1) relative to smaller match ratios ($1:$1) had no additional impact. The results have clear implications for practitioners in the design of fundraising campaigns and provide avenues for future empirical and theoretical work on charitable giving. Further, the data provide an interesting test of important methods used in cost-benefit analysis.
John A List, David Lucking-Reiley
Cited by*: 161 Downloads*: 25

We test two recent theories on the subject of charitable fundraising in capital campaigns. Andreoni (1998) predicts that publicly announced seed contributions can increase the total amount of charitable giving in a capital campaign. Bagnoli and Lipman (1989) predict that another technique for increasing contributions is a promise to refund donors' money in case the campaign threshold is not reached. Using a field experiment in a capital campaign for the Center for Environmental Policy Analysis at the University of Central Florida, we present evidence on both of these predictions. Data from direct mail solicitations sent to 3000 Central Floridian residents confirm the basic comparative-static predictions of both theories: total contributions increase with the amount of seed money, and with the use of a refund policy. A change in seed money from 10% to 67% of the campaign goal resulted in nearly a sixfold increase in contributions, while imposing a refund increased contributions by a more modest 20%. Seed money has a statistically significant effect on both the proportion of people choosing to donate and on the average gift size of those who donate, while refunds have a statistically significant effect only on the average gift size. These results have clear implications for practitioners in the design of fundraising campaigns.
Steven D Levitt, John A List, Susanne Neckermann, Sally Sadoff
Cited by*: 0 Downloads*: 161

Research on behavioral economics has established the importance of factors such as reference dependent preferences, hyperbolic preferences, and the value placed on non-financial rewards. To date, these insights have had little impact on the way the educational system operates. Through a series of field experiments involving thousands of primary and secondary school students, we demonstrate the power of behavioral economics to influence educational performance. Several insights emerge. First, we find that incentives framed as losses have more robust effects than comparable incentives framed as gains. Second, we find that non-financial incentives are considerably more cost-effective than financial incentives for younger students, but were not effective with older students. Finally, and perhaps most importantly, consistent with hyperbolic discounting, all motivating power of the incentives vanishes when rewards are handed out with a delay. Since the rewards to educational investment virtually always come with a delay, our results suggest that the current set of incentives may lead to under-investment. For policymakers, our findings imply that in the absence of immediate incentives, many students put forth low effort on standardized tests, which may create biases in measures of student ability, teacher value added, school quality, and achievement gaps.
Omar Al-Ubaydli, Steffen Andersen, Uri Gneezy, John A List
Cited by*: 0 Downloads*: 2

Constructing compensation schemes for effort in multi-dimensional tasks is complex, particularly when some dimensions are not easily observable. When incentive schemes contractually reward workers for easily observed measures, such as quantity produced, the standard model predicts that unrewarded dimensions, such as quality, will be neglected. Yet, there remains mixed empirical evidence in favor of this standard principal-agent model prediction. This paper reconciles the literature by using both theory and empirical evidence. The theory outlines conditions under which principals can use a piece rate scheme to induce higher quantity and quality levels than analogous fixed wage schemes. Making use of a series of complementary laboratory and field experiments we show that this effect occurs because the agent is uncertain about the principal's monitoring ability and the principal's choice of a piece rate signals to the agent that she is efficient at monitoring.
Jonathan E Alevy, Craig E Landry, John A List
Cited by*: 4 Downloads*: 46

A pillar of behavioral research is that preferences are constructed during the process of choice. A prominent finding is that uninformative numerical "anchors" influence judgment and valuation. It remains unclear whether such processes influence market equilibria. We conduct two experiments that extend the study of anchoring to field settings. The first experiment produces evidence that some consumers' valuations can be anchored in novel situations; there is no evidence that experienced agents are influenced by anchors. The second experiment finds that anchors have only transient effects on market outcomes that converge to equilibrium predictions after a few market periods.
Omar Al-Ubaydli, John A List
Cited by*: 2 Downloads*: 1

Economists are increasingly turning to the experimental method as a means to estimate causal effects. By using randomization to identify key treatment effects, theories previously viewed as untestable are now scrutinized, efficacy of public policies are now more easily verified, and stakeholders can swiftly add empirical evidence to aid their decision-making. This study provides an overview of experimental methods in economics, with a special focus on developing an economic theory of generalizability. Given that field experiments are in their infancy, our secondary focus pertains to a discussion of the various parameters that they identify, and how they add to scientific knowledge. We conclude that until we conduct more field experiments that build a bridge between the lab and the naturally-occurring settings of interest we cannot begin to make strong conclusions empirically on the crucial question of generalizability from the lab to the field.
Per Fredriksson , John A List, Warren McHone , Daniel L Millimet
Cited by*: 59 Downloads*: 20

This study examines the effects of air quality regulation on economic activity. Anecdotal evidence and some recent empirical studies suggest that an inverse relationship exists between the stringency of environmental regulations and new plant formations. Using a unique county-level data set for New York State from 1980 to 1990, we revisit this conjecture using a seminonparametric method based on propensity score matching. Our empirical estimates suggest that pollution-intensive plants are responding to environmental regulations; more importantly, we find that traditional parametric methods used in previous studies may dramatically understate the impact of more stringent regulations.
John A List, Daniel L Millimet
Cited by*: 3 Downloads*: 6

Devolution of tasks to local levels of government has recently become a popular agenda item within certain political factions in the US. While one expects the local policymaker to tailor policies to match the preferences of his constituents, critics of local policymaking claim that externalities are ignored and inefficiencies thus arise under local control of certain policies. A primary example concerns the control of pollution, which is known to have adverse effects on neighbouring jurisdictions. Whether localities actually 'race to the bottom' and enact lax environmental policies when given the chance remains an open issue. In this study, we make use of stochastic dominance tests to examine if President Reagan's policy of 'New Federalism' in the early 1980s induced states to lower environmental standards. Among the several environmental measures analysed, we do not find any evidence that the 'race to the bottom' materialized. Indeed, the evidence shows that even during these lean years of federal intervention several indicators of environmental quality at the state level continued to improve.
John A List, Jason F Shogren
Cited by*: 9 Downloads*: 8

n/a
Steffen Andersen, Seda Ertac, Uri Gneezy, John A List, Sandra Maximiano
Cited by*: 35 Downloads*: 2

Recent literature presents evidence that men are more competitively inclined than women. Since top-level careers usually require competitiveness, competitiveness differences provide an explanation for gender gaps in wages and differences in occupational choice. A natural question is whether women are born less competitive or whether they become so through the process of socialization. To pinpoint when in the socialization process the difference arises, we compare the competitiveness of children in matrilineal and patriarchal societies. We find that while there is no difference at any age in the matrilineal society, girls become less competitive around puberty in the patriarchal society.
Omar Al-Ubaydli, John A List, Dana L Suskind
Cited by*: 3 Downloads*: 87

No abstract available
John A List, Fatemeh Momeni, Michael Vlassopoulos, Yves Zenou
Cited by*: Downloads*:

This study explores the role of neighborhoods on human capital formation at an early age. We do so by estimating the spillover effects of an early childhood intervention on the educational attainment of a large sample of disadvantaged children in the United States. We document large spillover effects on the cognitive skills of children living near treated children, which amount to approximately 40% of the direct treatment effects. Interestingly, these spillover effects are localized and decrease with the spatial distance to treated neighbors. We do not find evidence of spillover effects on non-cognitive skills. Perhaps our most novel insight is the underlying mechanisms at work: the spillover effect on cognitive scores is very localized and seems to operate through the child's social network, mostly between treated kids. We do not find evidence that parents' or children's social networks are effective for non-cognitive skills. Overall, our results reveal the importance of public programs and neighborhoods on human capital formation at an early age, highlighting that human capital accumulation is fundamentally a social activity.
Amanda Chuan, John A List, Anya Samek, Shreemayi Samujjwala
Cited by*: Downloads*:

Parental investments shape children's educational specializations. Using a longitudinal study, we find that parents invest more in daughters than sons at ages 3-5. We find that early parental investment can explain persistently higher English scores for girls than boys 4-6 years later. However, there is no gender gap in Math. Parental investments at ages 3-5 appear to contribute to girls' advantage in English but have little impact on Math. Our results suggest that parental investments at early ages contributes to girls' comparative advantage in English.
Omar Al-Ubaydli, Jason Chien-Yu, John A List
Cited by*: Downloads*:

The "voltage effect" is defined as the tendency for a program's efficacy to change when it is scaled up, which in most cases results in the absolute size of a program's treatment effects to diminish when the program is scaled. Understanding the scaling problem and taking steps to diminish voltage drops are important because if left unaddressed, the scaling problem can weaken the public's faith in science, and it can lead to a misallocation of public resources. There exists a growing literature illustrating the prevalence of the scaling problem, explaining its causes, and proposing countermeasures. This paper adds to the literature by providing a simple model of the scaling problem that is consistent with rational expectations by the key stakeholders. Our model highlights that asymmetric information is a key contributor to the voltage effect.
Omar Al-Ubaydli, John A. List
Cited by*: Downloads*:

The A/B testing approach invites promising early results that are unlikely to be realized in a larger setting. We argue that within the social sciences, a fundamentally different approach is needed; we call it option C thinking. Put simply, a twenty-first-century team of civil servants and social scientists should lead with experiments that anticipate likely causes of failure at scale, even if doing so requires more time, effort, and resources initially.