Papers - All

Uri Gneezy, Moshe Hoffman, John A List

Cited by*: 8 Downloads*: 22

Women remain significantly underrepresented in the science, engineering, and technology workforce. Some have argued that spatial ability differences, which represent the most persistent gender differences in the cognitive literature, are partly responsible for this gap. The underlying forces at work shaping the observed spatial ability differences revolve naturally around the relative roles of nature and nurture. Although these forces remain among the most hotly debated in all of the sciences, the evidence for nurture is tenuous, because it is difficult to compare gender differences among biologically similar groups with distinct nurture. In this study, we use a large-scale incentivized experiment with nearly 1,300 participants to show that the gender gap in spatial abilities, measured by time to solve a puzzle, disappears when we move from a patrilineal society to an adjoining matrilineal society. We also show that about one-third of the effect can be explained by differences in education. Given that none of our participants have experience with puzzle solving and that villagers from both societies have the same means of subsistence and shared genetic background, we argue that these results show the role of nurture in the gender gap in cognitive abilities.

Dean S Karlan, Jonathan Zinman

Cited by*: 2 Downloads*: 20

Information asymmetries are important in theory but difficult to identify in practice. We estimate the empirical importance of adverse selection and moral hazard in a consumer credit market using a new field experiment methodology. We randomized 58,000 direct mail offers issued by a major South African lender along three dimensions: 1) the initial "offer interest rate" appearing on direct mail solicitations; 2) a "contract interest rate" equal to or less than the offer interest rate and revealed to the over 4,000 borrowers who agreed to the initial offer rate; and 3) a dynamic repayment incentive that extends preferential pricing on future loans to borrowers who remain in good standing. These three randomizations, combined with complete knowledge of the Lender's information set, permit identification of specific types of private information problems. Specifically, our setup distinguishes adverse selection from moral hazard effects on repayment, and thereby generates unique evidence on the existence and magnitudes of specific credit market failures. We find evidence of both adverse selection (among women) and moral hazard (predominantly among men), and the findings suggest that about 20% of default is due to asymmetric information problems. This helps explain the prevalence of credit constraints even in a market that specializes in financing high-risk borrowers at very high rates.

Uri Gneezy, Andreas Leibbrandt, John A List

Cited by*: 1 Downloads*: 9

The functioning and well-being of any society and organization critically hinges on norms of cooperation that regulate social activities. Empirical evidence on how such norms emerge and in which environments they thrive remains a clear void in the literature. To provide an initial set of insights, we overlay a set of field experiments in a natural setting. Our approach is to compare behavior in Brazilian fishermen societies that differ along one major dimension: the workplace organization. In one society (located by the sea) fishermen are forced to work in groups whereas in the adjacent society (located on a lake) fishing is inherently an individual activity. We report sharp evidence that the sea fishermen trust and cooperate more and have greater ability to coordinate group actions than their lake fishermen counterparts. These findings are consistent with the argument that people internalize social norms that emerge from specific needs and support the idea that socio-ecological factors play a decisive role in the proliferation of pro-social behaviors.

Amee Kamdar, Steven D Levitt, John A List, Brian Mullaney, Chad Syverson

Cited by*: None Downloads*: None

In this paper, we present the results of a two-year series of large-scale natural field experiments involving hundreds of thousands of subjects.

Sam Asher, Lorenzo Casaburi, Plamen Nikolov, Maoliang Ye

Cited by*: 2 Downloads*: 8

We study how gradualism -- increasing required levels ("thresholds") of contributions slowly over time rather than requiring a high level of contribution immediately -- affects individuals' decisions to contribute to a public project. Using a laboratory binary choice minimum-effort coordination game, we randomly assign participants to three treatments: starting and continuing at a high threshold, starting at a low threshold but jumping to a high threshold after a few periods, and starting at a low threshold and gradually increasing the threshold over time (the "gradualism" treatment). We find that individuals coordinate most successfully at the high threshold in the gradualism treatment relative to the other two groups. We propose a theory based on belief updating to explain why gradualism works. We also discuss alternative explanations such as reinforcement learning, conditional cooperation, inertia, preference for consistency, and limited attention. Our findings point to a simple, voluntary mechanism to promote successful coordination when the capacity to impose sanctions is limited.

John A List, Zacharias Maniadis, Fabio Tufano

Cited by*: 0 Downloads*: 3

In his comment, Mitesh Kataria (2014) makes three main points about a specific part of our paper (Maniadis, Tufano, and List 2014), namely about Tables 2 and 3. In our paper, we employ these tables in order to illustrate the idea that very inconclusive post-study probabilities that a tested phenomenon is true may result from novel, surprising findings. The main arguments in Kataria (2014) are the following: First, if P(H0) is unknown, as is often the case with economic applications, the post-study probability can lead to even worse inference than the Classical significance test, depending on the quality of the prior. Second, the simulation in Maniadis et al. (2014) ignores previous assessments of P(H0) and instead utilizes a selective empirical setup that favors the use of post-study probabilities. [Third,] contrary to what Maniadis et al. (2014) argue, their results do not allow for drawing general recommendations about which approach is the most appropriate. (Kataria 2014, abs.) We believe that our work might have been misunderstood by Kataria. Moreover, it seems that some of his claims are not supported by relevant empirical evidence.

Antoni Bosch-Domenech, Jose Garcia-Montalvo, Rosemarie Nagel, Albert Satorra

Cited by*: 42 Downloads*: 14

"Beauty-contest is a game in which participants have to choose, typically, a number in [0,100], the winner being the person whose number is closest to a proportion of the average of all chosen numbers. We describe and analyze Beauty-contest experiments run in newspapers in UK, Spain, and Germany and find stable patterns of behavior across them, despite the uncontrollability of these experiments. These results are then compared with lab experiments involving undergraduates and game theorists as subjects, in what must be one of the largest empirical corroborations of interactive behavior ever tried. We claim that all observed behavior, across a wide variety of treatments and subject pools, can be interpreted as iterative reasoning. Level-1 reasoning, Level-2 reasoning and Level-3 reasoning are commonly observed in all the samples, while the equilibrium choice (Level-Maximum reasoning) is only prominently chosen by newspaper readers and theorists. The results show the empirical power of experiments run with large subject-pools, and open the door for more experimental work performed on the rich platform offered by newspapers and magazines."

Yan Chen, Xin Li, Jeffrey K MacKie-Mason

Cited by*: 13 Downloads*: 11

We implemented the first web-based online field experiments of fund-raising. We embedded our experiment in the Internet Public Library to test four mechanisms: Voluntary Contribution (VCM), Premium, Seed Money and Matching. Although the gift size is not significantly different across mechanisms, the Seed and Matching mechanisms each generate significantly higher user click-through response rate than the Premium mechanism. Because this is one of the earliest embedded, web-based field experiments, we report our methodology findings in some detail. Cookies work better as participant assignment techniques than pop-up windows and elicitation of geographic information. Participant clickstream data that nominally demonstrate a desire to donate is a poor predictor of actual giving.

Matthew A. Kraft, John A List, Jeffrey A Livingston, Sally Sadoff

Cited by*: None Downloads*: None

In-person tutoring programs can have large impacts on K-12 student achievement, but high program costs and limited local supply of tutors have hampered scale-up. Online tutoring provided by volunteers can potentially reach more students in need. We implemented a randomized pilot program of online tutoring that paired college volunteers with middle school students. We estimate consistently positive but statistically insignificant effects on student achievement, 0.07s for math and 0.04s for reading. While our estimated effects are smaller than those for many higher-dosage in-person programs, they are from a significantly lower-cost program delivered within the challenging context of the COVID-19 pandemic.

Charles Bellemare, Sabine Kroger

Cited by*: 0 Downloads*: 5

This paper analyzes data for a random sample drawn from the Dutch population who reveal their capacity to provide and sustain social capital by their propensity to invest and reward investments by means of an economic experiment. We have three main results. First, we find that heterogeneity in behavior is characterized by several asymmetries men, the young and elderly, and low educated individuals invest relatively less, but reward significantly more investments. Second, higher expected levels of investments have a positive and significant effect on the level of investments themselves, corroborating the presence of social norms. Third, we compare our results with a laboratory experiment conducted with a student sample. We find that the student sample provides a lower bound of the population level of social capital.

Omar Al-Ubaydli, John A List

Cited by*: 2 Downloads*: 4

Economists are increasingly turning to the experimental method as a means to estimate causal effects. By using randomization to identify key treatment effects, theories previously viewed as untestable are now scrutinized, efficacy of public policies are now more easily verified, and stakeholders can swiftly add empirical evidence to aid their decision-making. This study provides an overview of experimental methods in economics, with a special focus on developing an economic theory of generalizability. Given that field experiments are in their infancy, our secondary focus pertains to a discussion of the various parameters that they identify, and how they add to scientific knowledge. We conclude that until we conduct more field experiments that build a bridge between the lab and the naturally-occurring settings of interest we cannot begin to make strong conclusions empirically on the crucial question of generalizability from the lab to the field.

Omar Al-Ubaydli, John A List

Cited by*: 2 Downloads*: 1

Economists are increasingly turning to the experimental method as a means to estimate causal effects. By using randomization to identify key treatment effects, theories previously viewed as untestable are now scrutinized, efficacy of public policies are now more easily verified, and stakeholders can swiftly add empirical evidence to aid their decision-making. This study provides an overview of experimental methods in economics, with a special focus on developing an economic theory of generalizability. Given that field experiments are in their infancy, our secondary focus pertains to a discussion of the various parameters that they identify, and how they add to scientific knowledge. We conclude that until we conduct more field experiments that build a bridge between the lab and the naturally-occurring settings of interest we cannot begin to make strong conclusions empirically on the crucial question of generalizability from the lab to the field.

John A List

Cited by*: 82 Downloads*: 10

The dictator game represents a workhorse within experimental economics, frequently used to test theory and to provide insights into the prevalence of social preferences. This study explores more closely the dictator game and the literature's preferred interpretation of its meaning by collecting data from nearly 200 dictators across treatments that varied the action set and the origin of endowment. The action set variation includes choices in which the dictator can "take" money from the other player. Empirical results question the received interpretation of dictator game giving: many fewer agents are willing to transfer money when the action set includes taking. Yet, a result that holds regardless of action set composition is that agents do not ubiquitously choose the most selfish outcome. The results have implications for theoretical models of social preferences, highlight that "institutions" matter a great deal, and point to useful avenues for future research using simple dictator games and relevant manipulations.

Daniel Houser, John A List, Marco Piovesan, Anya Samek, Joachim Winter

Cited by*: 2 Downloads*: 56

Acts of dishonesty permeate life. Understanding their origins, and what mechanisms help to attenuate such acts is an under explored area of research. This study takes an economics approach to explore the propensity of individuals to act dishonestly across different economic environments. We begin by developing a simple model that highlights the channels through which one can increase or decrease dishonest acts. We lend empirical insights into this model by using an experiment that includes both parents and their young children as subjects. We find that the highest level of dishonesty occurs in settings where the parent acts alone and the dishonest act benefits the child rather than the parent. In this spirit, there is also an interesting effect of children on parents' behavior: in the child's presence, parents act more honestly, but there are gender differences. Parents act more dishonestly in front of sons than daughters. This finding has the potential of shedding light on the origins of the widely documented gender differences in cheating behavior observed among adults.

John A List, Jan Stoop, Daan van Soest, Haiwen Zhou

Cited by*: 2 Downloads*: 3

Both private and public organizations constantly grapple with incentive schemes to induce maximum effort from agents. We begin with a theoretical exploration of optimal contest design, focusing on the number of competitors. Our theory reveals a critical link between the distribution of luck and the number of contestants. We find that if there is considerable (little) mass on good draws, equilibrium effort is an increasing (decreasing) function of the number of contestants. Our first test of the theory implements a laboratory experiment, where important features of the theory can be exogenously imposed. We complement our lab experiment with a field experiment, where we rely on biological models complemented by economic models to inform us of the relevant theoretical predictions. In both cases we find that the theory has a fair amount of explanatory power, allowing a deeper understanding of how to effectively design tournaments. From a methodological perspective, our study showcases the benefits of combining data from both lab and field experiments to deepen our understanding of the economic science.

John A List

Cited by*: None Downloads*: None

Social scientists have increasingly turned to the experimental method to understand human behavior. One critical issue that makes solving social problems difficult is "scaling" the idea from a small group to a larger group in more diverse situations. The urgency of scaling policies impacts us every day, whether it is protecting the health and safety of a community or enhancing the opportunities of future generations. Yet, a common result is that when we scale ideas most experience a "voltage drop": upon scaling, the benefit-cost profile depreciates considerably. To combat voltage drops, we must optimally generate policy-based evidence. Optimality requires answering two crucial questions: what information to generate and in what sequence. The economics underlying the science of scaling provides insights into these questions, which are in some cases at odds with conventional approaches. For example, there are important situations wherein I advocate flipping the traditional social science research model to an approach that, from the beginning, produces the type of policy-based evidence that the science of scaling demands. To do so, I propose augmenting efficacy trials by including relevant tests of scale in the original discovery process, which forces the scientist to naturally start with a recognition of the big picture: what information do I need to haves caling confidence?

John A List

Cited by*: None Downloads*: None

Presentation Slides

Matthias Sutter

Cited by*: 20 Downloads*: 46

Economic decisions depend on both actual outcomes as well as perceived intentions. In this paper, we examine whether and how the relative importance of outcomes or intentions for economic decisions develops with age. We report the results of ultimatum games with children, teens and university students. We find that children and teens react systematically to perceived intentions, like university students do. However, children and teens reject unequal offers much more often than university students, indicating that outcomes are relatively more important than intentions for younger subjects. Hence, the relative importance of intentions increases with age.

Maria De Paola, Francesca Gioia, Vincenzo Scoppa

Cited by*: 1 Downloads*: 10

We analyze how overconfidence is affected by superstitious beliefs and emotions induced by positive and negative stimuli in a field experiment involving about 700 Italian students who were randomly assigned to numbered seats in their written examination sessions. According to widespread superstitions, some numbers are considered lucky, while others are considered unlucky. At the end of the examination, we asked students the grade they expected to get. We find that students tend to be systematically overconfident and that their overconfidence is positively affected by being assigned to a lucky number. Interestingly, males and females react differently: on the one hand, females tend to expect lower grades when assigned to unlucky numbers, while they are not affected by being assigned to lucky numbers. On the other hand, males are not affected by being assigned to unlucky numbers but expect higher grades when assigned to lucky numbers.

Roland Fryer , Steven D Levitt, John A List

Cited by*: 9 Downloads*: 6

This article describes a randomized field experiment in which parents were provided financial incentives to engage in behaviors designed to increase early childhood cognitive and executive function skills through a parent academy. Parents were rewarded for attendance at early childhood sessions, completing homework assignments with their children, and for their child's demonstration of mastery on interim assessments. This intervention had large and statistically significant positive impacts on both cognitive and non-cognitive test scores of Hispanics and Whites, but no impact on Blacks. These differential outcomes across races are not attributable to differences in observable characteristics (e.g. family size, mother's age, mother's education) or to the intensity of engagement with the program. Children with above median (pre-treatment) non cognitive scores accrue the most benefits from treatment.