Papers - Artefactual

Gary Charness, Brian Jabarian, John A List

Cited by*: None Downloads*: None

We investigate the potential for Large Language Models (LLMs) to enhance scientific practice within experimentation by identifying key areas, directions, and implications. First, we discuss how these models can improve experimental design, including improving the elicitation wording, coding experiments, and producing documentation. Second, we discuss the implementation of experiments using LLMs, focusing on enhancing causal inference by creating consistent experiences, improving comprehension of instructions, and monitoring participant engagement in real time. Third, we highlight how LLMs can help analyze experimental data, including pre-processing, data cleaning, and other analytical tasks while helping reviewers and replicators investigate studies. Each of these tasks improves the probability of reporting accurate findings. Finally, we recommend a scientific governance blueprint that manages the potential risks of using LLMs for experimental research while promoting their benefits. This could pave the way for open science opportunities and foster a culture of policy and industry experimentation at scale.

Sera Linardi, Nita Rudra

Cited by*: 0 Downloads*: 66

Can globalization change our willingness to redistribute to the poor? We propose the hypothesis that in developing countries, the 'glitter' of foreign direct investment (FDI) reduces public support for redistribution by creating perceptions of better employment opportunities for the poor. Initial evidence is derived from World Value Survey responses from developing economies. Delving deeper, a framed field experiment in India reveals foreign ownership of low-skilled firms reduces redistribution to the poor. We further find that rich conservatives drive this reduction. This analysis provides the first experimental evidence of the causal impact of globalization on redistribution, mediated by ideology and income.

Juan-Camilo Cardenas

Cited by*: 5 Downloads*: 40

No abstract available

John A List, Anya Samek, Michael K Price

Cited by*: 0 Downloads*: 2

No abstract available

Iwan Barankay, Magnus Johannesson, John A List, Richard Friberg, Matti Liski, Kjetil Storesletten

Cited by*: 1 Downloads*: 1

No abstract available

Steven D Levitt, John A List

Cited by*: 38 Downloads*: 65

No abstract available

John A List

Cited by*: 4 Downloads*: 46

No abstract available

Vic Adamowicz, Jonathan E Alevy, John A List

Cited by*: 0 Downloads*: 10

Psychological insights have made inroads within most major areas of study in economics. One area where less advance has been made is environmental and resource economics. In this study, we examine the implications of preference reversals over evaluation modes, in which stated economic values critically depend on whether the good is valued jointly with others or in isolation. The question arises because two commonly used methods for eliciting stated preferences differ in that one presents objects together and another presents objects to be evaluated in isolation. Beyond showing an example of the import of behavioral economics, our empirical evidence sheds new light on the factors associated with insensitivity of valuations to the scope of the good

Omar Al-Ubaydli, John A List, Claire Mackevicius, Min Sok Lee, Dana L Suskind

Cited by*: None Downloads*: None

Policymakers are increasingly turning to insights gained from the experimental method as a means to inform large scale public policies. Critics view this increased usage as premature, pointing to the fact that many experimentally-tested programs fail to deliver their promise at scale. Under this view, the experimental approach drives too much public policy. Yet, if policymakers could be more confident that the original research findings would be delivered at scale, even the staunchest critics would carve out a larger role for experiments to inform policy. Leveraging the economic framework of Al-Ubaydli et al. (2019), we put forward 12 simple proposals, spanning researchers, policymakers, funders, and stakeholders, which together tackle the most vexing scalability threats. The framework highlights that only after we deepen our understanding of the scale up problem will we be on solid ground to argue that scientific experiments should hold a more prominent place in the policymaker's quiver.

John A List

Cited by*: None Downloads*: None

ASSA 2023 presentation

Juan-Camilo Cardenas

Cited by*: 2 Downloads*: 58

The use of experimental settings to observe human behaviour in a controlled environment of incentives, rules and institutions, has been widely used by the behavioural sciences for some time now, particularly by psychology and economics. In most cases the subjects are college students recruited from one to two hour decision making exercises in which, depending on their choices, they earn cash averaging US$ 20. In such exercises players face a set of feasible actions, rules and incentives (payoffs) involving different forms of social exchange with other people, and that in most cases involve some kind of externalities with incomplete contracts, such as in the case of common-pool resources situations. Depending on the ecological and institutional settings, the resource users face a set of feasible levels of extraction, a set of rules regarding the control or monitoring of individual use, and sometimes ways of imposing material or non-material costs or rewards to those breaking or following the rules. We brought the experimental lab to the field and invited about two hundred users of natural resources in three Columbian rural villages to participate in such decision making exercises and through these and other research instruments we learned about the ways they solve - or fail to - tragedies of the commons with different social institutions. Further, bringing the lab to the field allowed us to explore some of the limitations of existing models about human behavior and its consequences for designing policies for conserving ecosystems and improving social welfare.

John A List, Ragan Petrie, Anya Samek

Cited by*: None Downloads*: None

In the past several decades the experimental method has lent deep insights into economics. One surprising area that has contributed is the experimental study of children, where advances as varied as the evolution of human behaviors that shape markets and institutions to how early life influences shape later life outcomes have been explored. We first develop a framework for economic preference measurement that provides a lens into how to interpret data from experiments with children. Next, we survey work that provides general empirical insights within our framework. Finally, we provide 10 tips for pulling off experiments with children, including factors such as taking into account child competencies, causal identification, and logistical issues related to recruitment and implementation. We envision the experimental study of children as a high growth research area in the coming decades as social scientists begin to more fully appreciate that children are active participants in markets who (might) respond predictably to economic incentives.

Stefan Luckner, Christof Weinhardt

Cited by*: 9 Downloads*: 12

The results of recent studies on prediction markets are encouraging. Prior experience demonstrates that markets with different incentive schemes predicted uncertain future events remarkably accurately. In this paper, we study the impact of different monetary incentives on prediction accuracy in a field experiment. In order to do so, we compare three groups of traders, corresponding to three treatments with different payment schemes, in a prediction market for the FIFA World Cup 2006. Somewhat surprisingly, our results show that performance-related payment schemes do not necessarily increase the prediction accuracy. Due to the risk aversion of traders the competitive environment in a rank-order tournament leads to the best results in terms of prediction accuracy.

Elvis Cheng Xu

Cited by*: None Downloads*: None

We conduct a field trust game under a natural experiment context to test the impacts of urbanisation on trust. We conjecture that urbanisation, defined in this context as the process of state-led rural-urban migration, contributes to a transformation of trust levels among co-villagers and towards outsiders. We test this conjecture in an experimental approach and more generally, examine whether the urbanisation will produce significant impacts on in-group trust and out-group trust. The research finds that urbanisation does not decrease significantly the trust towards co-villagers, meaning the in-group trust did not change statistically significantly. However, the trust towards outsiders does increase as a result of the state-led urbanisation. We also run a regression on the trust exhibited towards participants in the experiment and found the partial effect of whether they are co-villagers or outsiders weakens as a result of the urbanisation, and therefore conclude urbanisation decreases out-group discrimination in trust.

Jared Rubin, Anya Samek, Roman Sheremeta

Cited by*: 0 Downloads*: 17

Firms face an optimization problem that requires a maximal quantity output given a quality constraint. How firms should incentivize quantity and quality to meet these dual goals remains an open question. We provide a theoretical model and conduct an experiment in which participants are paid for both quantity and quality of a real effort task. Consistent with the theoretical predictions, higher quality incentives encourage participants to shift their attention from quantity to quality and to decrease the error rate at the expense of lowering quantity of output. This quantity-quality trade-off is significantly impacted by the participant's ability and level of loss aversion.

Alberto Cavallo, Guillermo Cruces, Ricardo Perez-Truglia

Cited by*: 3 Downloads*: 15

Information frictions play a central role in the formation of household inflation expectations, but there is no consensus about their origins. We address this question with novel evidence from survey experiments. We document two main findings. First, individuals in lower-inflation contexts have significantly weaker priors about the inflation rate. This finding suggests that rational inattention may be an important source of information frictions. Second, cognitive limitations also appear to be a source of information frictions: even when information about inflation statistics is made readily available, individuals still place a significant weight on less accurate sources of information, such as their memories of the price changes of the supermarket products they purchase. We discuss the implications of these findings for macroeconomic models and policy-making.

John A List

Cited by*: 13 Downloads*: 59

No abstract available

Samuel Bowles, Robert Boyd, Colin F Camerer, Ernst Fehr, Herbert Gintis, Joseph Henrich, Richard McElreath

Cited by*: 75 Downloads*: 66

al behavior better explained statistically by individuals' attributes such as their sex, age, or relative wealth, or by the attributes of the group to which the individuals belong? Are there cultures that approximate the canonical account of self-regarding behavior? Existing research cannot answer such questions because virtually all subjects have been university students, and while there are cultural differences among student populations throughout the world, these differences are small compared to the range of all social and cultural environments. To address the above questions, we and our collaborators undertook a large cross-cultural study of behavior in ultimatum, public good, and dictator games. Twelve experienced field researchers, working in 12 countries on five continents, recruited subjects from 15 small-scale societies exhibiting a wide variety of economic and cultural conditions. Our sample consists of three foraging societies, six that practice slash-and-burn horticulture

Heike Hennig-Schmidt, Bettina Rockenbach, Abdolkarim Sadrieh

Cited by*: 6 Downloads*: 7

We present a field experiment to assess the effect of own and peer wage variations on actual work effort of employees with hourly wages. Work effort neither reacts to an increase of the own wage, nor to a positive or negative peer comparison. This result seems at odds with numerous laboratory experiments that show a clear own wage sensitivity on effort. In an additional real-effort laboratory experiment we show that explicit cost and surplus information that enables to exactly calculate employer's surplus from the work contract is a crucial pre-requisite for a positive wage-effort relation. This demonstrates that employee's reciprocity requires a clear assessment of the surplus at stake.

Wojciech Hardy, Michal Krawczyk, Joanna Tyrowicz

Cited by*: None Downloads*: None

We report results of an experimental study analyzing the effects of Internet piracy on book sales. We conducted a year-long controlled large-scale field experiment with pre-treatment pair matching. Half of the book titles received experiment treatment, in which a specialized agency would immediately remove any unauthorized copy appearing on the Internet. For the other half we merely registered such occurrences, but no countermeasures were taken. For all the titles we obtained print and e-book sales statistics from the publishers. We find that removal of unauthorized copies was an effective method of curbing piracy, but this had no bearing on legal sales.