{"title":"Non-rationalizable Individuals, Stochastic Rationalizability, and Sampling","authors":"Changkuk Im, John Rehbeck","doi":"10.2139/ssrn.3767994","DOIUrl":"https://doi.org/10.2139/ssrn.3767994","url":null,"abstract":"Experimental work regularly finds that individual choices are not deterministically rationalized by well-defined preferences. Nonetheless, recent work shows that data collected from many individuals can be stochastically rationalized by a distribution of well-defined preferences. We study the relationship between deterministic and stochastic rationalizability. We show that a population can be stochastically rationalized even when half of the individuals in the population cannot be deterministically rationalized. We also find the ability to detect individuals who are not deterministically rationalized from population level data can decrease as the number of observations increases.","PeriodicalId":362544,"journal":{"name":"PSN: Experimental Design (Topic)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132698223","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Emel Filiz-Ozbay, Huseyin Gulen, Yusufcan Masatlioglu, Erkut Y. Ozbay
{"title":"Comparing Ambiguous Urns with Different Sizes","authors":"Emel Filiz-Ozbay, Huseyin Gulen, Yusufcan Masatlioglu, Erkut Y. Ozbay","doi":"10.2139/ssrn.3183973","DOIUrl":"https://doi.org/10.2139/ssrn.3183973","url":null,"abstract":"We investigate experimentally preferences between different ambiguous processes generated by two-color Ellsberg urns. By providing symmetric information on urns with different numbers of beads and keeping the information on the most optimistic, pessimistic, and equal probability of winning possibilities the same, we elicit subjects' preferences for the size of an ambiguous urn. Subjects prefer the bets from the ambiguous urns with more beads. We analyze the role of ambiguity aversion and ratio bias of subjects in this behavior. We study the restrictions that our findings impose on the existing ambiguity models.","PeriodicalId":362544,"journal":{"name":"PSN: Experimental Design (Topic)","volume":"88 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126699897","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Should the Randomistas (Continue to) Rule?","authors":"M. Ravallion","doi":"10.3386/W27554","DOIUrl":"https://doi.org/10.3386/W27554","url":null,"abstract":"The rising popularity of randomized controlled trials (RCTs) in development applications has come with continuing debates about the merits of this approach. The chapter takes stock of the issues. It argues that an unconditional preference for RCTs is questionable on three main counts. First, the case for such a preference is unclear on a priori grounds. For example, with a given budget, even a biased observational study can come closer to the truth than a costly RCT. Second, the ethical objections to RCTs have not been properly addressed by advocates. Third, there is a risk of distorting the evidence-base for informing policy-making, given that an insistence on RCTs generates selection bias in what gets evaluated. Going forward, pressing knowledge gaps should drive the questions asked and how they are answered, not the methodological preferences of some researchers. The gold standard is the best method for the question at hand.","PeriodicalId":362544,"journal":{"name":"PSN: Experimental Design (Topic)","volume":"133 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114497756","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Majoritarian Bargaining over Budgetary Divisions and Policy","authors":"A. Baranski, Nicholas Haas, R. Morton","doi":"10.2139/ssrn.3672273","DOIUrl":"https://doi.org/10.2139/ssrn.3672273","url":null,"abstract":"We report the results of a field-in-the-lab experiment in which subjects bargain over a two-dimensional agenda: a donation to a political interest group and the division of a sum of money. We show that subjects sacrifice monetary gains to secure preferred policies and that behaviorally elicited preference intensity correlates with bargaining behavior. We find an ideological majority advantage and a status- quo premium. Minorities benefit most from negotiating on two dimensions because the budgetary division problem allows compromise. Finally, we show that induced preferences over artificial policies fail to capture the bargaining dynamics that arise when real ideological choices are involved.","PeriodicalId":362544,"journal":{"name":"PSN: Experimental Design (Topic)","volume":"46 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125394698","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Improving Out-of-Sample Predictions Using Response Times and a Model of the Decision Process","authors":"J. Clithero","doi":"10.2139/ssrn.2798459","DOIUrl":"https://doi.org/10.2139/ssrn.2798459","url":null,"abstract":"A basic problem in empirical economics involves using data from one domain to make out-of-sample predictions for a different, but related environment. When the choice data are binary, a canonical method for making these types of predictions is the logistic choice model. This paper investigates whether it is possible to improve out-of-sample predictions by changing two aspects of the canonical approach: 1) Using response times in addition to the choice data, and 2) Combining them using a model from the psychology and neuroscience literature, the Drift-Diffusion Model (DDM). Two experiments compare the out-of-sample choice prediction accuracies of both methods and in both cases the DDM method outperforms a logistic prediction method. Furthermore, the DDM allows for out-of-sample process predictions. Both experiments validate the DDM as a method for predicting out-of-sample response times.","PeriodicalId":362544,"journal":{"name":"PSN: Experimental Design (Topic)","volume":"446 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115617646","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. Gans-Morse, A. Kalgin, A. Klimenko, A. Yakovlev
{"title":"Motivations for Public Service in Corrupt States: Evidence from Post-Soviet Russia","authors":"J. Gans-Morse, A. Kalgin, A. Klimenko, A. Yakovlev","doi":"10.2139/ssrn.3072181","DOIUrl":"https://doi.org/10.2139/ssrn.3072181","url":null,"abstract":"Throughout much of the world, corruption in the civil service undermines state capacity, impedes economic development, and saps citizens’ morale. But while its pernicious effects are widely recognized, the roots of corruption remain poorly understood. Whereas most studies on corruption’s origins focus on the incentives bureaucrats face once in office, this study contributes to a line of recently emerging research that considers the role of self-selection of citizens with a propensity for corruption into bureaucracies where corruption is known to be widespread. Drawing on a survey and experimental games conducted with students at an elite university in Moscow, Russia, we compare the attitudinal, behavioral, and demographic traits of students seeking public sector employment to the traits of their peers seeking jobs in the private sector. Contrary to studies conducted in other high-corruption contexts, such as India, we find surprising evidence that students who prefer a public sector career display lss willingness to cheat or bribe in experimental games as well as higher levels of altruism. One interpretation of these findings is that corruption in Russia results from the transformation of bureaucrats’ behavior and attitudes after entering the civil service, rather than through a process of corrupt self-selection","PeriodicalId":362544,"journal":{"name":"PSN: Experimental Design (Topic)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128761642","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"P-Hacking in Experimental Accounting Studies","authors":"Xin Chang, Huasheng Gao, Wei Li","doi":"10.2139/ssrn.3762342","DOIUrl":"https://doi.org/10.2139/ssrn.3762342","url":null,"abstract":"We study the extent and determinants of p-hacking in experimental accounting studies. Using a text-mining approach to extract p-values from experimental studies published in three highly regarded accounting journals, we find an unusual abundance of p-values that are just significant: the observed frequency of p-values equal to 0.05 is about 26% higher than what would be expected based on the frequency of other p-values. This suggests that some researchers may have p-hacked to obtain “just significant” results. Further analyses reveal that p-hacking is more evident in articles by untenured authors, early-career researchers, authors from highly ranked schools, male authors, or sole authors. Moreover, the p-hacking evidence is stronger in articles with more experiment participants or in tests concerning key results. More cited articles exhibit a greater extent of p-hacking, indicating that p-hacking helps attract citations. Lastly, we document that the data and code disclosure policy adopted by the Journal of Accounting Research in 2014 mitigates p-hacking.","PeriodicalId":362544,"journal":{"name":"PSN: Experimental Design (Topic)","volume":"36 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124825615","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An Experimental Approach to Measuring Ideological Positions in Political Text","authors":"John A. Henderson","doi":"10.2139/ssrn.2852784","DOIUrl":"https://doi.org/10.2139/ssrn.2852784","url":null,"abstract":"Though powerful as general tools, automated measures of position-taking in text often perform poorly when models of speech are difficult to develop or theoretically contested. Rather than model text, I develop an experimental approach to measure perceptions of partisanship in speech, with an application to 2008 Congressional advertisements. I randomly assign ads to subjects recruited in a large-N survey, and ask them to ‘guess’ the party of featured candidates, with ads scored as their average party inference. These party perception scores are empirically synonymous with a liberal-conservative dimension, and highly reliable across samples and experimental conditions. Party identity has little impact on guesses, indicating the inferential task significantly mutes partisan bias. For validation, I assess which words influence guessing, and whether ad-scores correspond to expectations about how candidates target voters. Importantly, this experimental approach can augment or validate automated text analysis, and generalize to study speech across many other contexts.","PeriodicalId":362544,"journal":{"name":"PSN: Experimental Design (Topic)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128581759","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Attention Variation and Welfare: Theory and Evidence from a Tax Salience Experiment","authors":"Dmitry Taubinsky, A. Rees-Jones","doi":"10.3386/W22545","DOIUrl":"https://doi.org/10.3386/W22545","url":null,"abstract":"This paper shows that accounting for variation in mistakes can be crucial for welfare analysis. Focusing on consumer underreaction to not-fully-salient sales taxes, we show theoretically that the efficiency costs of taxation are amplified by differences in underreaction across individuals and across tax rates. To empirically assess the importance of these issues, we implement an online shopping experiment in which 2,998 consumers purchase common household products, facing tax rates that vary in size and salience. We replicate prior findings that, on average, consumers underreact to non-salient sales taxes—consumers in our study react to existing sales taxes as if they were only 25% of their size. However, we find significant individual differences in this underreaction, and accounting for this heterogeneity increases the efficiency cost of taxation estimates by at least 200%. Tripling existing sales tax rates nearly doubles consumers’ attention to taxes, and accounting for this endogeneity increases efficiency cost estimates by 336%. Our results provide new insights into the mechanisms and determinants of boundedly rational processing of not-fully-salient incentives, and our general approach provides a framework for robust behavioral welfare analysis.","PeriodicalId":362544,"journal":{"name":"PSN: Experimental Design (Topic)","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125313112","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Does It Matter Which Effort Task You Use? A Comparison of Four Effort Tasks When Agents Compete for a Prize","authors":"E. Lezzi, Piers Fleming, D. J. Zizzo","doi":"10.2139/ssrn.2594659","DOIUrl":"https://doi.org/10.2139/ssrn.2594659","url":null,"abstract":"Effort tasks are commonly used to assess individual investment and performance in an experimental setting. Although the tasks used are diverse, they are typically intended to be equivalent as far as they aim to generalize beyond the specific task. We compare an induced value effort task and three real effort tasks in a contest game. Results show that there is no equivalence across tasks in relation to how risk attitude, anxiety and gender predict performance.","PeriodicalId":362544,"journal":{"name":"PSN: Experimental Design (Topic)","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133626152","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}