Papers - All

Maria De Paola, Rosetta Lombardo, Valeria Pupo, Vincenzo Scoppa

Cited by*: None Downloads*: None

Public speaking is an important skill for career prospects and for leadership positions, but many people tend to avoid it because it generates anxiety. We run a field experiment to analyze whether in an incentivized setting men and women show differences in their willingness to speak in public. The experiment involved more than 500 undergraduate students who could gain two points to add to the final grade of their exam by presenting solutions to a problem set. Students were randomly assigned to present only to the instructor or in front of a large audience (a class of 100 or more). We find that while women are more willing to present face-to-face, they are considerably less likely to give a public presentation. Female aversion to public speaking does not depend on differences in ability, risk aversion, self-confidence and self-esteem. The aversion to public speaking greatly reduces for daughters of working women. From data obtained through an on-line Survey we also show that neither increasing the gains deriving from public speaking nor allowing participants more time to prepare enable to close the gender gap.

Omar Al-Ubaydli, John A List, Claire Mackevicius, Min Sok Lee, Dana L Suskind

Cited by*: None Downloads*: None

Policymakers are increasingly turning to insights gained from the experimental method as a means to inform large scale public policies. Critics view this increased usage as premature, pointing to the fact that many experimentally-tested programs fail to deliver their promise at scale. Under this view, the experimental approach drives too much public policy. Yet, if policymakers could be more confident that the original research findings would be delivered at scale, even the staunchest critics would carve out a larger role for experiments to inform policy. Leveraging the economic framework of Al-Ubaydli et al. (2019), we put forward 12 simple proposals, spanning researchers, policymakers, funders, and stakeholders, which together tackle the most vexing scalability threats. The framework highlights that only after we deepen our understanding of the scale up problem will we be on solid ground to argue that scientific experiments should hold a more prominent place in the policymaker's quiver.

Erwin Bulte, John A List, Daan van Soest

Cited by*: None Downloads*: None

Incomplete contracts are the rule rather than the exception, and any incentive scheme faces the risk of improving performance on incented aspects of a task at the detriment of performance on non-incented aspects. Recent research documents the effect of loss-framed versus gain-framed incentives on incentivized behavior, but how do such incentives affect overall performance? We explore potential trade-offs by conducting field experiments in an artificial "workplace". We explore two types of incentive spillovers: those contemporaneous to the incented task and those subsequent to the incented task. We report three main results. First, consonant with the extant literature, a loss aversion incentive induces greater effort on the incented task. Second, offsetting this productivity gain, we find that the quality of work decreases if quality is not specified in the incentive contract. Third, we find no evidence of harmful spillover effects to subsequent tasks; if anything, the loss aversion incentive induces more effort in subsequent tasks. Taken together, our results highlight that measuring and accounting for incentive spillovers are important when considering their overall impact.

Bharat Chandar, Ali Hortacsu, John A List, Ian Muir, Jeffrey M Wooldridge

Cited by*: None Downloads*: None

Field experiments conducted with the village, city, state, region, or even country as the unit of randomization are becoming commonplace in the social sciences. While convenient, subsequent data analysis may be complicated by the constraint on the number of clusters in treatment and control. Through a battery of Monte Carlo simulations, we examine best practices for estimating unit-level treatment effects in cluster-randomized field experiments, particularly in settings that generate short panel data. In most settings we consider, unit-level estimation with unit fixed effects and cluster-level estimation weighted by the number of units per cluster tend to be robust to potentially problematic features in the data while giving greater statistical power. Using insights from our analysis, we evaluate the effect of a unique field experiment: a nationwide tipping field experiment across markets on the Uber app. Beyond the import of showing how tipping affects aggregate outcomes, we provide several insights on aspects of generating and analyzing cluster-randomized experimental data when there are constraints on the number of experimental units in treatment and control.

Alec Brandon, John A List, Robert D Metcalfe, Michael K Price, Florian Rundhammer

Cited by*: None Downloads*: None

This study considers the response of household electricity consumption to social nudges during peak load events. Our investigation considers two social nudges. The first targets conservation during peak load events, while the second promotes aggregate conservation. Using data from a natural field experiment with 42,100 households, we find that both social nudges reduce peak load electricity consumption by 2 to 4% when implemented in isolation and by nearly 7% when implemented in combination. These findings suggest an important role for social nudges in the regulation of electricity markets and a limited role for crowd out effects.

Syon Bhanot, Jiyoung Han, Chaning Jang

Cited by*: None Downloads*: None

Restrictions like work requirements and constraints on voucher transfers are often used in social welfare systems, but little empirical evidence exists on their impact on wellbeing. We conducted a 10-day randomized experiment with 432 individuals living below the poverty line in the Kawangware settlement of Nairobi, kenya, testing two elements of social welfare design: workfare versus welfare and restricted versus unrestricted vouchers. Participants were randomly assigned to a "Work" condition, involving daily work for unrestricted vouchers, or one of two "Wait" conditions, involving daily waiting for vouchers that were either unrestricted or partially restricted to staple foods. We find that working improved psychological wellbeing relative to waiting, suggesting that means of implementing welfare programs may have important effects on individuals beyond the impact of monetary benefit alone. Furthermore, although restrictions were inframarginal, partially restricted vouchers crowded-in spending on staple foods, suggesting the existence of a "flypaper effect" in spending from restricted vouchers.

Fulya Ersoy

Cited by*: None Downloads*: None

While distance learning has become widespread, causal estimates regarding returns to effort in technology-assisted learning environments are scarce due to high attrition rates and endogeneity of effort. In this paper, I manipulate effort by randomly assigning students different numbers of lessons in a popular online language learning platform. Using administrative data from the platform and the instrumental variables strategy, I find that completing 9 Duolingo lessons, which corresponds to approximately 60 minutes of studying, leads to a 0.057-0.095 standard deviation increase in test scores. Comparisons to the literature and back-of-the-envelope calculations suggest that distance learning can be as effective as in-person learning for college students for an introductory language course

Wojciech Hardy, Michal Krawczyk, Joanna Tyrowicz

Cited by*: None Downloads*: None

We report results of an experimental study analyzing the effects of Internet piracy on book sales. We conducted a year-long controlled large-scale field experiment with pre-treatment pair matching. Half of the book titles received experiment treatment, in which a specialized agency would immediately remove any unauthorized copy appearing on the Internet. For the other half we merely registered such occurrences, but no countermeasures were taken. For all the titles we obtained print and e-book sales statistics from the publishers. We find that removal of unauthorized copies was an effective method of curbing piracy, but this had no bearing on legal sales.

Syon Bhanot

Cited by*: None Downloads*: None

Social norms messaging campaigns are increasingly used to influence human behavior, with social science research generally finding that they have modest but meaningful effects. One aspect of these campaigns in practice has been the inclusion of injunctive norms messaging, designed to convey a social judgement about one's behaviors (often in the form of encouraging or discouraging language, or a visual smiley or frowny face). While some prominent research has provided support for the use of such messaging as a tool for positive behavior change, causal evidence on the effect of injunctive norms messaging as a motivator (as opposed to just one part of a multifaceted messaging campaign) is limited. This paper presents a field experiment on water conservation behavior conducted by an organization in California, involving over 40,000 households, which provides some of the most precise evidence to date regarding the effect of injunctive norms on decision making. I find that not only do injunctive norms encourage conservation behavior, there is also no evidence that they discourage individuals from further attending norms messaging-regardless of whether the social judgement conveyed is negative or positive. Taken together, this suggests that injunctive norms are a useful tool in "nudge"-style campaigns tackling behavior change.

John A List, Julie Pernaudet, Dana L Suskind

Cited by*: None Downloads*: None

Socioeconomic inequalities in child development crystallize at early stages, with associated disparities in parental investment in children. A key to understanding the data patterns is to document the sources underlying the observed inequalities. We first show that there are dramatic differences in parental beliefs across socioeconomic backgrounds (SES), with parents of higher SES being more likely to believe that parental investments impact child development. We then use two field experiments targeted to low-SES families to explore the mutability of such beliefs and their link to parental investments. In both cases, we find that parental beliefs about child development are malleable. The less intensive version of the program based on educational videos changes parental beliefs, but fails to lastingly increase parental investments and child outcomes. By contrast, in the more intensive version of our program combining home visits and feedback, the augmented beliefs are associated with enriched parent-child interactions and improved vocabulary, math, and social-emotional skills for the children. Together, these results suggest that changing parental beliefs can be an important pathway to raising parental investments and reducing socioeconomic gaps in children's skills, but that simple informational policies may not be sufficient.

Maya Haran Rosen , Orly Sade

Cited by*: None Downloads*: None

Define contribution mechanism combined with a dynamic job market can affect the sum of retirement savings and the choices of plans and products. Hence, it is important for regulators to engage servers to manage the accounts they accumulate over the years. In 2013-2014 the Israeli regulator reached out to the population, recommending the use of a website to help individuals find inactive retirement savings accounts and close them (withdraw the savings or transfer them to active accounts). The government's efforts did not result in the closure of most of the inactive accounts. Proprietary data indicate that those who closed the inactive accounts live in central locations with a higher socioeconomic index. Survey data indicate that those who lacked financial literacy and confidence in their financial knowledge were less likely to take financial actions. Using a controlled field experiment, we also provide evidence that an intervention with a human touch can promote greater involvement.

Shubha Chakravarty, Mattias Lundberg, Plamen Nikolov, Juliane Zenker

Cited by*: None Downloads*: None

Lack of skills is arguably one of the most important determinants of high levels of unemployment and poverty. In response, policymakers often initiate vocational training programs in effort to enhance skill formation among the youth. Using a regression-discontinuity design, we examine a large youth training intervention in Nepal. We find, twelve months after the start of the training program, that the intervention generated an increase in non-farm employment of 10 percentage points (ITT estimates) and up to 31 percentage points for program compliers (LATE estimates). We also detect sizable gains in monthly earnings. Women who start self-employment activities inside their homes largely drive these impacts. We argue that low baseline educational levels and non-farm employment levels and Nepal's social and cultural norms towards women drive our large program impacts. Our results suggest that the program enables otherwise underemployed women to earn an income while staying at home - close to household errands and in line with the socio-cultural norms that prevent them from taking up employment outside the house.

John A List

Cited by*: None Downloads*: None

These are the slides from John A. List's keynote at the 2022 AFE conference.

Hansika Kapoor, Savita Kulkarni, Anirudh Tagat

Cited by*: None Downloads*: None

This study aims to investigate intra-household bargaining outcomes elicited in an artefactual field experiment design where participants completed a purchase task of real commodities. Married couples separately expressed their initial preferences over commodities. The bargaining process in the experiment was exogenously introduced by sharing information about partners' preferences in the treatment group. We hypothesized that the spouse with weaker bargaining position at the household level would consider the information of their partner's preferences while making own consumption decisions more compared to their partner. Therefore, they may deviate from their own preferences when purchasing commodities. More than 230 married couples from two villages in the Tamil Nadu state of India participated in the experiment. It was observed that information about partners' spending preferences resulted in reduced final allocation for female participants. However, the deviation was not significantly different from the original intention to spend. Therefore, information about partners' preferences may not be an effective medium to elicit bargaining power in the context of jointly-consumed household commodities. Subgroup analyses were performed to identify any heterogeneous treatment effects.

Maria De Paola, Francesca Gioia, Vincenzo Scoppa

Cited by*: None Downloads*: None

We ran a field experiment to investigate whether competing in rank-order tournaments with different prize spreads affects individual performance. Our experiment involved students from an Italian University who took an exam that was partly evaluated on the basis of relative performance. Students were matched in pairs on the basis of their high school grades and each pair was randomly assigned to one of three different tournaments. Random assignment neutralizes selection effects and allows us to investigate if larger prize spreads increase individual effort. We do not find any positive effect of larger prizes on performance. Furthermore, we show that the effect of prize spreads on students' performance depends on their degree of risk-aversion: competing in tournaments with large spreads negatively affects the performance of risk-averse students, while it does not produce any effect on students who are more prone to taking risks.

Amanda Bayer, Syon Bhanot, Fernando Lozano

Cited by*: None Downloads*: None

No abstract available

Rudolf Kerschbamer, Daniel Neururer, Matthias Sutter

Cited by*: None Downloads*: None

Honesty is a fundamental pillar for cooperation in human societies and thus for their economic welfare. However, humans do not always act in an honest way. Here, we examine how insurance coverage affects the degree of honesty in credence good markets. Such markets are plagued by strong incentives for fraudulent behavior of sellers, resulting in estimated annual costs of billions of dollars to costumers and the society as a whole. Prime examples of credence goods are all kinds of repair services, the provision of medical treatments, the sale of software programs, and the provision of taxi rides in unfamiliar cities. We examine in a natural field experiment how computer repair shops take advantage of costumers' insurance for repair costs. In a control treatment, the average repair price is about EUR 70, whereas the repair bill increases by more than 80% when the service provider is informed that an insurance would reimburse the bill. Our design allows decomposing the sources of this economically impressive difference, showing that it is mainly due to the overprovision of parts and overcharging of working time. A survey among repair shops shows that the higher bills are mainly ascribed to insured costumers being less likely to be concerned about minimizing costs because a third party (the insurer) pays the bill. Overall, our results strongly suggest that insurance coverage greatly increases the extent of dishonesty in important sectors of the economy with potentially huge costs to costumers and whole economies.

Andreas Leibbrandt, John A List

Cited by*: None Downloads*: None

Labor force composition and the allocation of talent remain of vital import to modern economies. For their part, governments and companies around the globe have implemented equal employment opportunity (EEO) regulations to influence labor market flows. Even though such regulations are pervasive, surprisingly little is known about their impacts. We use a natural field experiment conducted across 10 U.S. cities to investigate if EEO statements in job advertisements affect the first step in the employment process, application rates. Making use of data from nearly 2,500 job seekers, we find considerable policy effects, but in an unexpected direction: the presence of an EEO statement dampens rather than encourages racial minorities willingness to apply for jobs. Importantly, the effects are particularly pronounced for educated job seekers and in cities with white majority populations. Complementary survey evidence suggests the underlying mechanism at work is "tokenism", revealing that EEO statements backfire because racial minorities avoid environments in which they are perceived as regulatory, or symbolic, hires rather than being hired on their own merits. Beyond their practical and theoretical importance, our results highlight how field experiments can significantly improve policy making. In this case, if one goal of EEO regulations is to enhance the pool of minority applicants, then it is not working.

Avner Ben-Ner, John A List, Louis Putterman, Anya Samek

Cited by*: None Downloads*: None

An active area of research within the social sciences concerns the underlying motivation for sharing resources and engaging in other pro-social actions. In this paper we ask: do parents model social preference behavior to children, and do children emulate this behavior? We develop a theoretical framework to examine this question, and conduct an experiment with 147 3 to 5 year old children and their parents, using dictator games to measure generosity. We find (1) evidence of parental teaching/modeling in the case of fathers and in that of parents of relatively generous children, and (2) an emulation effect such that children who initially share less than half of their endowment subsequently share more the more they see a parent or other adult share. We find little correlation between baseline sharing of children and the parents, with the possible exception of the oldest children.

Omar Al-Ubaydli, John A. List

Cited by*: None Downloads*: None

The A/B testing approach invites promising early results that are unlikely to be realized in a larger setting. We argue that within the social sciences, a fundamentally different approach is needed; we call it option C thinking. Put simply, a twenty-first-century team of civil servants and social scientists should lead with experiments that anticipate likely causes of failure at scale, even if doing so requires more time, effort, and resources initially.