{"title":"在选择性停止中混淆实验证据的揭露。","authors":"Renata Sadibolova, Devin B Terhune","doi":"10.3758/s13428-025-02813-0","DOIUrl":null,"url":null,"abstract":"<p><p>Optional stopping refers to the practice of repeatedly performing a statistical analysis on a dataset as new data are collected until a pre-specified decision criterion is reached. This procedure is often adopted because of its effectiveness in optimizing data collection. Discussions of optional stopping to date have primarily centred around statistical issues, with relatively little consideration of any methodological implications of this procedure. Building on recent work drawing attention to methodological biases arising from the use of optional stopping, we highlight experimenter awareness of the current evidence state during data collection (experimenter evidence unmasking) as a salient methodological confound of optional stopping. We argue that experimenter evidence unmasking has the potential to influence an experimenter to implicitly or explicitly modify their behaviour in ways that can reduce the internal validity of an experiment. We conclude by offering recommendations for circumventing this confound and for the transparent reporting of experimenter evidence masking procedures.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 11","pages":"296"},"PeriodicalIF":3.9000,"publicationDate":"2025-09-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12460446/pdf/","citationCount":"0","resultStr":"{\"title\":\"Experimenter evidence unmasking as a confound in optional stopping.\",\"authors\":\"Renata Sadibolova, Devin B Terhune\",\"doi\":\"10.3758/s13428-025-02813-0\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Optional stopping refers to the practice of repeatedly performing a statistical analysis on a dataset as new data are collected until a pre-specified decision criterion is reached. This procedure is often adopted because of its effectiveness in optimizing data collection. Discussions of optional stopping to date have primarily centred around statistical issues, with relatively little consideration of any methodological implications of this procedure. Building on recent work drawing attention to methodological biases arising from the use of optional stopping, we highlight experimenter awareness of the current evidence state during data collection (experimenter evidence unmasking) as a salient methodological confound of optional stopping. We argue that experimenter evidence unmasking has the potential to influence an experimenter to implicitly or explicitly modify their behaviour in ways that can reduce the internal validity of an experiment. We conclude by offering recommendations for circumventing this confound and for the transparent reporting of experimenter evidence masking procedures.</p>\",\"PeriodicalId\":8717,\"journal\":{\"name\":\"Behavior Research Methods\",\"volume\":\"57 11\",\"pages\":\"296\"},\"PeriodicalIF\":3.9000,\"publicationDate\":\"2025-09-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12460446/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Behavior Research Methods\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.3758/s13428-025-02813-0\",\"RegionNum\":2,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"PSYCHOLOGY, EXPERIMENTAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Behavior Research Methods","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.3758/s13428-025-02813-0","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, EXPERIMENTAL","Score":null,"Total":0}
Experimenter evidence unmasking as a confound in optional stopping.
Optional stopping refers to the practice of repeatedly performing a statistical analysis on a dataset as new data are collected until a pre-specified decision criterion is reached. This procedure is often adopted because of its effectiveness in optimizing data collection. Discussions of optional stopping to date have primarily centred around statistical issues, with relatively little consideration of any methodological implications of this procedure. Building on recent work drawing attention to methodological biases arising from the use of optional stopping, we highlight experimenter awareness of the current evidence state during data collection (experimenter evidence unmasking) as a salient methodological confound of optional stopping. We argue that experimenter evidence unmasking has the potential to influence an experimenter to implicitly or explicitly modify their behaviour in ways that can reduce the internal validity of an experiment. We conclude by offering recommendations for circumventing this confound and for the transparent reporting of experimenter evidence masking procedures.
期刊介绍:
Behavior Research Methods publishes articles concerned with the methods, techniques, and instrumentation of research in experimental psychology. The journal focuses particularly on the use of computer technology in psychological research. An annual special issue is devoted to this field.