Papers - Artefactual

Eliot Abrams, Jonathan Libgober, John A List

Cited by*: None Downloads*: None

The past few decades have ushered in an experimental revolution in economics whereby scholars are now much more likely to generate their own data. While there are virtues associated with this movement, there are concomitant difficulties. Several scientific disciplines, including economics, have launched research registries in an effort to attenuate key inferential issues. This study assesses registries both empirically and theoretically, with a special focus on the AEA registry. We find that over 90% of randomized controlled trials (RCTs) in economics do not register, only 50% of the RCTs that register do so before the intervention begins, and the majority of these preregistrations are not detailed enough to significantly aid inference. Our empirical analysis further shows that using other scientific registries as aspirational examples is misguided, as their perceived success in tackling the main issues is largely a myth. In light of these facts, we advance a simple economic model to explore potential improvements. A key insight from the model is that removal of the (current) option to register completed RCTs could increase the fraction of trials that register. We also argue that linking IRB applications to registrations could further increase registry effectiveness.

Wojciech Hardy, Michal Krawczyk, Joanna Tyrowicz

Cited by*: None Downloads*: None

We report results of an experimental study analyzing the effects of Internet piracy on book sales. We conducted a year-long controlled large-scale field experiment with pre-treatment pair matching. Half of the book titles received experiment treatment, in which a specialized agency would immediately remove any unauthorized copy appearing on the Internet. For the other half we merely registered such occurrences, but no countermeasures were taken. For all the titles we obtained print and e-book sales statistics from the publishers. We find that removal of unauthorized copies was an effective method of curbing piracy, but this had no bearing on legal sales.

Plamen Nikolov

Cited by*: None Downloads*: None

Attitudes toward risk underlie virtually every important economic decision an individual makes. In this experimental study, I examine how introducing a time delay into the execution of an investment plan influences individuals' risk preferences. The field experiment proceeded in three stages: a decision stage, an execution stage and a payout stage. At the outset, in the Decision Stage (Stage 1), each subject was asked to make an investment plan by splitting a monetary investment amount between a risky asset and a safe asset. Subjects were informed that the investment plans they made in the Decision Stage are binding and will be executed during the Execution Stage (Stage 2). The Payout Stage (Stage 3) was the payout date. The timing of the Decision Stage and Payout Stage was the same for each subject, but the timing of the Execution Stage varied experimentally. I find that individuals who were assigned to execute their investment plans later (i.e., for whom there was a greater delay prior to the Execution Stage) invested a greater amount in the risky asset during the Decision Stage.

Yan Chen, Peter Cramton, John A List, Axel Ockenfels

Cited by*: None Downloads*: None

We review past research and discuss future directions on how the vibrant research areas of market design and behavioral economics have influenced and will continue to impact the science and practice of management in both the private and public sectors. Using examples from various auction markets, reputation and feedback systems in online markets, matching markets in education, and labor markets, we demonstrate that combining market design theory, behavioral insights, and experimental methods can lead to fruitful implementation of superior market designs in practice.

Greg Allenby, Russell Belk, Catherine Eckel, Robert Fisher, Ernan Haruvy, John A List, Yu Ma, Peter Popkowski Leszczyc, Yu Wang, Sherry Xin Li

Cited by*: None Downloads*: None

We offer a unified conceptual, behavioral, and econometric framework for optimal fundraising that deals with both synergies and discrepancies between approaches from economics, consumer behavior, and sociology. The purpose is to offer a framework that can bridge differences and open a dialogue between disciplines in order to facilitate optimal fundraising design. The literature is extensive, and our purpose is to offer a brief background and perspective on each of the approaches, provide an integrated framework leading to new insights, and discuss areas of future research.

John A List, Ragan Petrie, Anya Samek

Cited by*: None Downloads*: None

In the past several decades the experimental method has lent deep insights into economics. One surprising area that has contributed is the experimental study of children, where advances as varied as the evolution of human behaviors that shape markets and institutions to how early life influences shape later life outcomes have been explored. We first develop a framework for economic preference measurement that provides a lens into how to interpret data from experiments with children. Next, we survey work that provides general empirical insights within our framework. Finally, we provide 10 tips for pulling off experiments with children, including factors such as taking into account child competencies, causal identification, and logistical issues related to recruitment and implementation. We envision the experimental study of children as a high growth research area in the coming decades as social scientists begin to more fully appreciate that children are active participants in markets who (might) respond predictably to economic incentives.

John A List

Cited by*: None Downloads*: None

Last year I put together a summary of data from my field experiments website that pertained to artefactual field experiments. Several people have asked me if I have and update. In this document I update all figures and numbers to show the details for 2020. I also include the description from the 2019 paper.

Syon Bhanot, Jiyoung Han, Chaning Jang

Cited by*: None Downloads*: None

Restrictions like work requirements and constraints on voucher transfers are often used in social welfare systems, but little empirical evidence exists on their impact on wellbeing. We conducted a 10-day randomized experiment with 432 individuals living below the poverty line in the Kawangware settlement of Nairobi, kenya, testing two elements of social welfare design: workfare versus welfare and restricted versus unrestricted vouchers. Participants were randomly assigned to a "Work" condition, involving daily work for unrestricted vouchers, or one of two "Wait" conditions, involving daily waiting for vouchers that were either unrestricted or partially restricted to staple foods. We find that working improved psychological wellbeing relative to waiting, suggesting that means of implementing welfare programs may have important effects on individuals beyond the impact of monetary benefit alone. Furthermore, although restrictions were inframarginal, partially restricted vouchers crowded-in spending on staple foods, suggesting the existence of a "flypaper effect" in spending from restricted vouchers.

John A List

Cited by*: None Downloads*: None

No abstract available

Annika List, John A List, Anya Samek

Cited by*: None Downloads*: None

Social scientists for years have documented the pervasiveness of discrimination in product and labor markets. While the literature has recently attempted to measure the nature of such discrimination, much less work has been done exploring the origins of discrimination. We make a modest step in this direction by reporting data from a field experiment attempting to measure discrimination amongst 3-5 years olds. Using a design that isolated discriminatory behaviors in economic games, we find that both White and Hispanic children send more resources to Black children than White children, whereas black children send equal amounts. This provides a first glimpse that suggests preferences amongst the young do not show similar patterns as preferences of adults.

Luigi Butera, Philip J Grossman, Daniel Houser, John A List, Marie-Claire Villeval

Cited by*: None Downloads*: None

Creation of empirical knowledge in economics has taken a dramatic turn in the past few decades. One feature of the new research landscape is the nature and extent to which scholars generate data. Today, in nearly every field the experimental approach plays an increasingly crucial role in testing theories and informing organizational decisions. Whereas there is much to appreciate about this revolution, recently a credibility crisis has taken hold across the social sciences, arguing that an important component of Fischer (1935)'s tripod has not been fully embraced: replication. Indeed, while the importance of replications is not debatable scientifically, current incentives are not sufficient to encourage replications from the individual researcher's perspective. We propose a novel mechanism that promotes replications by leveraging mutually beneficial gains between scholars and editors. We develop a model capturing the trade-offs involved in seeking independent replications before submission of a paper to journals. We showcase our method via an investigation of the effects of Knightian uncertainty on cooperation rates in public goods games, a pervasive and yet largely unexplored feature in the literature.

Hansika Kapoor, Savita Kulkarni, Anirudh Tagat

Cited by*: None Downloads*: None

This study aims to investigate intra-household bargaining outcomes elicited in an artefactual field experiment design where participants completed a purchase task of real commodities. Married couples separately expressed their initial preferences over commodities. The bargaining process in the experiment was exogenously introduced by sharing information about partners' preferences in the treatment group. We hypothesized that the spouse with weaker bargaining position at the household level would consider the information of their partner's preferences while making own consumption decisions more compared to their partner. Therefore, they may deviate from their own preferences when purchasing commodities. More than 230 married couples from two villages in the Tamil Nadu state of India participated in the experiment. It was observed that information about partners' spending preferences resulted in reduced final allocation for female participants. However, the deviation was not significantly different from the original intention to spend. Therefore, information about partners' preferences may not be an effective medium to elicit bargaining power in the context of jointly-consumed household commodities. Subgroup analyses were performed to identify any heterogeneous treatment effects.

James Andreoni, Amalia Di Girolamo, John A List, Claire Mackevicius, Anya Samek

Cited by*: None Downloads*: None

We conduct experiments eliciting risk preferences with over 1,400 children and adolescents aged 3-15 years old. We complement our data with an assessment of cognitive and executive function skills. First, we find that adolescent girls display significantly greater risk aversion than adolescent boys. This pattern is not observed among young children, suggesting that the risk gap in risk preferences emerges in early adolescence. Second, we find that at all ages in our study, cognitive skills (specifically math ability) are positively associated with risk taking. Executive functions among children, and soft skills among adolescents, are negatively associated with risk taking. Third, we find that greater risk-tolerance is associated with higher likelihood of disciplinary referrals, which provides evidence that our task is equipped to measure a relevant behavioral outcome. For academics, our research provides a deeper understanding of the developmental origins of risk preferences and highlights the important role of cognitive and executive function skills to better understand the association between risk preferences and cognitive abilities over the studied age range.

Elvis Cheng Xu

Cited by*: None Downloads*: None

We conduct a field trust game under a natural experiment context to test the impacts of urbanisation on trust. We conjecture that urbanisation, defined in this context as the process of state-led rural-urban migration, contributes to a transformation of trust levels among co-villagers and towards outsiders. We test this conjecture in an experimental approach and more generally, examine whether the urbanisation will produce significant impacts on in-group trust and out-group trust. The research finds that urbanisation does not decrease significantly the trust towards co-villagers, meaning the in-group trust did not change statistically significantly. However, the trust towards outsiders does increase as a result of the state-led urbanisation. We also run a regression on the trust exhibited towards participants in the experiment and found the partial effect of whether they are co-villagers or outsiders weakens as a result of the urbanisation, and therefore conclude urbanisation decreases out-group discrimination in trust.

Omar Al-Ubaydli, John A List

Cited by*: None Downloads*: None

This is a review of the literature of field experimental studies of markets. The main results covered by the review are as follows: (1) Generally speaking, markets organize the efficient exchange of commodities; (2) There are some behavioral anomalies that impede efficient exchange; (3) Many behavioral anomalies disappear when traders are experienced.

Omar Al-Ubaydli, John A List, Claire Mackevicius, Min Sok Lee, Dana L Suskind

Cited by*: None Downloads*: None

Policymakers are increasingly turning to insights gained from the experimental method as a means to inform large scale public policies. Critics view this increased usage as premature, pointing to the fact that many experimentally-tested programs fail to deliver their promise at scale. Under this view, the experimental approach drives too much public policy. Yet, if policymakers could be more confident that the original research findings would be delivered at scale, even the staunchest critics would carve out a larger role for experiments to inform policy. Leveraging the economic framework of Al-Ubaydli et al. (2019), we put forward 12 simple proposals, spanning researchers, policymakers, funders, and stakeholders, which together tackle the most vexing scalability threats. The framework highlights that only after we deepen our understanding of the scale up problem will we be on solid ground to argue that scientific experiments should hold a more prominent place in the policymaker's quiver.

John A List

Cited by*: None Downloads*: None

These are the slides from John A. List's keynote at the 2022 AFE conference.

Avner Ben-Ner, John A List, Louis Putterman, Anya Samek

Cited by*: None Downloads*: None

An active area of research within the social sciences concerns the underlying motivation for sharing resources and engaging in other pro-social actions. In this paper we ask: do parents model social preference behavior to children, and do children emulate this behavior? We develop a theoretical framework to examine this question, and conduct an experiment with 147 3 to 5 year old children and their parents, using dictator games to measure generosity. We find (1) evidence of parental teaching/modeling in the case of fathers and in that of parents of relatively generous children, and (2) an emulation effect such that children who initially share less than half of their endowment subsequently share more the more they see a parent or other adult share. We find little correlation between baseline sharing of children and the parents, with the possible exception of the oldest children.

Eszter Czibor, David Jimenez-Gomez, John A List

Cited by*: None Downloads*: None

What was once broadly viewed as an impossibility - learning from experimental data in economics - has now become commonplace. Governmental bodies, think tanks, and corporations around the world employ teams of experimental researchers to answer their most pressing questions. For their part, in the past two decades academics have begun to more actively partner with organizations to generate data via field experimentation. While this revolution in evidence-based approaches has served to deepen the economic science, recently a credibility crisis has caused even the most ardent experimental proponents to pause. This study takes a step back from the burgeoning experimental literature and introduces 12 actions that might help to alleviate this credibility crisis and raise experimental economics to an even higher level. In this way, we view our "12 action wish list" as discussion points to enrich the field.

John A List

Cited by*: None Downloads*: None

2022 Summary of Artefactual Experiments