Steven D Levitt, John A List
Cited by*: 51 Downloads*: 30

We can think of no question more fundamental to experimental economics than understanding whether, and under what circumstances, laboratory results generalize to naturally occurring environments. In this paper, we extend Levitt and List (2006) to the class of games in which financial payoffs and doing the right thing are not necessarily in conflict. We argue that behaviour is crucially linked to not only the preferences of people, but also the properties of the situation. By doing so, we are able to provide a road map of the psychological and economic properties of people and situations that might interfere with generalizability of laboratory result from a broad class of games.
Michael S Haigh, John A List
Cited by*: 6 Downloads*: 12

An important class of investment decisions is characterized by unrecoverable sunk costs, resolution of uncertainty through time, and the ability to invest in the future as an alternative to investing today. The options model provides guidance in such settings, including an investment decision rule called the "bad news principle": the downside investment state influences the investment decision whereas the upside investment state is ignored. This study takes a new approach to examining predictions of the options model by using the tools of experimental economics. Our evidence, which is drawn from student and professional trader subject pools, is broadly consonant with the options model.
Steven D Levitt, John A List
Cited by*: 58 Downloads*: 52

This study presents an overview of modern field experiments and their usage in economics. Our discussion focuses on three distinct periods of field experimentation that have influenced the economics literature. The first might well be thought of as the dawn of "field" experimentation: the work of Neyman and Fisher, who laid the experimental foundation in the 1920s and 1930s by conceptualizing randomization as an instrument to achieve identification via experimentation with agricultural plots. The second, the large-scale social experiments conducted by government agencies in the mid-twentieth century, moved the exploration from plots of land to groups of individuals. More recently, the nature and range of field experiments has expanded, with a diverse set of controlled experiments being completed outside of the typical laboratory environment. With this growth, the number and types of questions that can be explored using field experiments has grown tremendously. After discussing these three distinct phases, we speculate on the future of field experimental methods, a future that we envision including a strong collaborative effort with outside parties, most importantly private entities.
John A List, Michael K Price
Cited by*: 15 Downloads*: 27

We explore collusion by using the tools of experimental economics in a naturally occurring marketplace. We report that competitive price theory adequately organizes data in multilateral decentralized bargaining markets without conspiratorial opportunities. When conspiratorial opportunities are allowed and contract prices are perfectly observed, prices (quantities) are considerably above (below) competitive levels. When sellers receive imperfect price signals, outcomes are intermediate to those of competitive markets and collusive markets with full information. Finally, experienced buyers serve as a catalyst to thwart attempts by sellers to engage in anticompetitive pricing: in periods where experienced agents transact in the market, average transaction prices are below those realized in periods where only inexperienced agents execute trades.
Glenn W Harrison, John A List
Cited by*: 0 Downloads*: 6

No abstract available
John A List, Daniel L Millimet
Cited by*: 20 Downloads*: 35

Assumptions of individual rationality and preference stability provide the foundation for a convenient and tractable modeling approach. While both of these assumptions have come under scrutiny in distinct literatures, the two lines of research remain disjointed. This study begins by explicitly linking the two literatures while providing insights into perhaps the central issue facing behavioral economics today: to what extent does market experience mitigate various forms of individual irrationality? We find considerable evidence that the market is a catalyst for rationality. The study then focuses on aggregate market outcomes by examining empirically whether individual rationality is a prerequisite for market efficiency. Using field data gathered from more than 380 subjects of age 6-18 in multi-lateral bargaining markets at a shopping mall, we find that the market is a filter of irrationality--even when markets are populated solely by irrational buyers, aggregate market outcomes quickly converge to neoclassical predictions.
John A List, David Lucking-Reiley
Cited by*: 40 Downloads*: 5

No abstract available
John A List, David Lucking-Reiley
Cited by*: 12 Downloads*: 9

Whether rationality of economic behavior increases with expected payoffs and decreases with the cognitive cost it takes to formulate an optimal strategy remains an open question. We explore these issues with field data, using individual bids from sealed-bid auctions in which we sold nearly $10,000 worth of sportscards. Our results indicate that stakes do indeed matter, as high-priced ($70) cards produced more of the theoretically predicted strategic behavior than did lower-priced ($3) cards. We find additional evidence consistent with the importance of cognitive costs, as subjects more experienced with sportscard auctions exhibited a greater tendency to behave strategically than did less experienced bidders.
John A List, Michael K Price
Cited by*: 14 Downloads*: 45

The economics literature suggests that enhanced social connection can increase trust amongst agents, which can ultimately lead to more efficient economic outcomes, including increased provision of public goods. This study provides a test of whether social connectedness (proxied via agent similarities in race and gender) influences giving to a charitable fundraiser. Using data gathered from more than 2000 households approached in an actual door-to-door fundraising drive, we find limited evidence of the importance of such social connections. A robust result in the data, however, is that our minority solicitors, whether approaching a majority or minority household, are considerably less likely to obtain a contribution, and conditional on securing a contribution, gift size is lower than their majority counterparts receive.
Omar Al-Ubaydli, John A List
Cited by*: 0 Downloads*: 60

A commonly held view is that laboratory experiments provide researchers with more "control" than natural field experiments, and that this advantage is to be balanced against the disadvantage that laboratory experiments are less generalizable. This paper presents a simple model that explores circumstances under which natural field experiments provide researchers with more control than laboratory experiments afford. This stems from the covertness of natural field experiments: laboratory experiments provide researchers with a high degree of control in the environment which participants agree to be experimental subjects. When participants systematically opt out of laboratory experiments, the researcher's ability to manipulate certain variables is limited. In contrast, natural field experiments bypass the participation decision altogether and allow for a potentially more diverse participant pool within the market of interest. We show one particular case where such selection is invaluable: when treatment effects interact with participant characteristics.
John A List, Azeem M Shaikh, Yang Xu
Cited by*: 33 Downloads*: 278

Empiricism in the sciences allows us to test theories, formulate optimal policies, and learn how the world works. In this manner, it is critical that our empirical work provides accurate conclusions about underlying data patterns. False positives represent an especially important problem, as vast public and private resources can be misguided if we base decisions on false discovery. This study explores one especially pernicious influence on false positives-multiple hypothesis testing (MHT). While MHT potentially affects all types of empirical work, we consider three common scenarios where MHT influences inference within experimental economics: jointly identifying treatment effects for a set of outcomes, estimating heterogenous treatment effects through subgroup analysis, and conducting hypothesis testing for multiple treatment conditions. Building upon the work of Romano and Wolf (2010), we present a correction procedure that incorporates the three scenarios, and illustrate the improvement in power by comparing our results with those obtained by the classic studies due to Bonferroni (1935) and Holm (1979). Importantly, under weak assumptions, our testing procedure asymptotically controls the familywise error rate - the probability of one false rejection - and is asymptotically balanced. We showcase our approach by revisiting the data reported in Karlan and List (2007), to deepen our understanding of why people give to charitable causes.
Omar Al-Ubaydli, John A List
Cited by*: 5 Downloads*: 89

A commonly held view is that laboratory experiments provide researchers with more "control" than natural field experiments, and that this advantage is to be balanced against the disadvantage that laboratory experiments are less generalizable. This paper presents a simple model that explores circumstances under which natural field experiments provide researchers with more control than laboratory experiments afford. This stems from the covertness of natural field experiments: laboratory experiments provide researchers with a high degree of control in the environment which participants agree to be experimental subjects. When participants systematically opt out of laboratory experiments, the researcher's ability to manipulate certain variables is limited. In contrast, natural field experiments bypass the participation decision altogether and allow for a potentially more diverse participant pool within the market of interest. We show one particular case where such selection is invaluable: when treatment effects interact with participant characteristics.
Steven D Levitt, John A List, Chad Syverson
Cited by*: 7 Downloads*: 12

Productivity improvements within establishments (e.g., factories, mines, or retail stores) are an important source of aggregate productivity growth. Past research has documented that learning by doing-productivity improvements that occur in concert with production increases-is one source of such improvements. Yet little is known about the specific mechanisms through which such learning occurs. We address this question using extremely detailed data from an assembly plant of a major auto producer. Beyond showing that there is rapid learning by doing at the plant, we are able to pinpoint the processes by which these improvements have occurred.
Omar Al-Ubaydli, John A List
Cited by*: 2 Downloads*: 4

Economists are increasingly turning to the experimental method as a means to estimate causal effects. By using randomization to identify key treatment effects, theories previously viewed as untestable are now scrutinized, efficacy of public policies are now more easily verified, and stakeholders can swiftly add empirical evidence to aid their decision-making. This study provides an overview of experimental methods in economics, with a special focus on developing an economic theory of generalizability. Given that field experiments are in their infancy, our secondary focus pertains to a discussion of the various parameters that they identify, and how they add to scientific knowledge. We conclude that until we conduct more field experiments that build a bridge between the lab and the naturally-occurring settings of interest we cannot begin to make strong conclusions empirically on the crucial question of generalizability from the lab to the field.
Per Fredriksson , John A List, Daniel L Millimet
Cited by*: 8 Downloads*: 1

Empirical evidence suggesting that a considerable amount of horizontal strategic interaction exists amongst governments is important in light of recent devolutionary trends of many important public programs. The empirical approach in these studies typically relies on estimating reaction functions in a uni-dimensional policy framework, where a nonzero slope estimate is interpreted as evidence in support of strategic interactions. While this framework is a useful representation within certain contexts, it is potentially too restrictive; for example, in models of resource competition, localities may use multiple instruments in their recruiting pursuits, leading to potential strategic interactions across policy instruments. In this study, we first develop a simple theoretic construct that includes resource competition in a world of three-dimensional policy choice. The model suggests that while a zero-sloped reaction function may exist for any particular policy, this does not necessarily imply the absence of strategic interactions. We examine the implications of the model empirically using US state-level panel data over the period 1977-1994. The results suggest that important cross-policy strategic interactions exist, lending support in favor of the multi-dimensional framework, and indicate that uni-dimensional frameworks may present lower bound estimates of the degree of strategic interaction.
John A List, David Lucking-Reiley
Cited by*: 29 Downloads*: 1

n/a
John A List, Jason F Shogren
Cited by*: 24 Downloads*: 1

Examining panel data on bidding behavior in over forty second-price auction markets with repeated trials, we observe that (i) posted prices influence the behavior of the median naive bidder; (ii) posted prices do not affect the behavior of the median experienced bidder or the bidder for familiar goods; and (iii) anticipated strategic behavior wanes after two trials. The results suggest that while affiliation might exist in auctions for new goods, the repeated trial design with nonprice information removes the correlation of values and provides the experience that bidders need to understand the market mechanism.
Erwin Bulte, John A List, Daan van Soest
Cited by*: None Downloads*: None

Social scientists have recently explored how framing of gains and losses affects productivity. We conducted a field experiment in peri-urban Uganda, and compared output levels across 1000 workers over isomorphic tasks and incentives, framed as either losses or gains. We find that loss aversion can be leveraged to increase the productivity of labor. The estimated welfare costs of using the loss contract are quite modest -- perhaps because the loss contract is viewed as a (soft) commitment device.
John A List, Julie Pernaudet, Dana L Suskind
Cited by*: None Downloads*: None

Socioeconomic inequalities in child development crystallize at early stages, with associated disparities in parental investment in children. A key to understanding the data patterns is to document the sources underlying the observed inequalities. We first show that there are dramatic differences in parental beliefs across socioeconomic backgrounds (SES), with parents of higher SES being more likely to believe that parental investments impact child development. We then use two field experiments targeted to low-SES families to explore the mutability of such beliefs and their link to parental investments. In both cases, we find that parental beliefs about child development are malleable. The less intensive version of the program based on educational videos changes parental beliefs, but fails to lastingly increase parental investments and child outcomes. By contrast, in the more intensive version of our program combining home visits and feedback, the augmented beliefs are associated with enriched parent-child interactions and improved vocabulary, math, and social-emotional skills for the children. Together, these results suggest that changing parental beliefs can be an important pathway to raising parental investments and reducing socioeconomic gaps in children's skills, but that simple informational policies may not be sufficient.
Greta List, John A List, Lina Ramirez, Anya Samek
Cited by*: None Downloads*: None

We conduct experiments with 720 children ages 9-11 to evaluate the relationship of time and risk preferences with health. Children who are more patient report consuming fewer unhealthy calories and spending less time on sedentary activities such as video games. Children who are more risk seeking report engaging in more exercise and more screen time. However, time and risk preferences are not predictive of body mass index (BMI). Moreover, some of the negative health behaviors, such as screen time, are associated with lower - rather than higher - BMI.