{"title":"Can Nudging Mentors Weaken Student Support? Experimental Evidence from a Virtual Communication Intervention","authors":"Stacey L. Brockman","doi":"10.1080/19345747.2023.2186291","DOIUrl":"https://doi.org/10.1080/19345747.2023.2186291","url":null,"abstract":"This paper presents results from a randomized trial of a nudge intervention designed to encourage and enhance virtual student support. During the 2019-20 school year, randomly selected mentors in a school-based mentoring program received monthly reminders with tips for communicating with youth via text, email, and phone. Unexpectedly, the results showed that although the informational reminders did not impact the frequency of mentors’ outreach, they reduced the rate at which students reached out and responded to their mentors. Moreover, and possibly as a consequence, mentors who received the intervention felt less connected to students and less satisfied with their mentoring relationships, and treated students gained less from the mentoring program as a whole in terms of their personal and attitudinal growth. This study’s findings add an important nuance to the evidence on how behavioral interventions in educational contexts operate. Although past studies find that reminder nudges can support individuals’ engagement in discrete tasks, this evidence suggests that prescribing relational practices may be less effective. Thus, mentor supports must be carefully designed in order to yield the intended benefits for students.","PeriodicalId":47260,"journal":{"name":"Journal of Research on Educational Effectiveness","volume":" ","pages":""},"PeriodicalIF":1.8,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43166755","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Chain as Strong as Its Strongest Link? Understanding the Causes and Consequences of Biases Arising from Selective Analysis and Reporting of Research Results","authors":"A. Gelman","doi":"10.1080/19345747.2023.2219673","DOIUrl":"https://doi.org/10.1080/19345747.2023.2219673","url":null,"abstract":"This is a big problem in applied statistics in general and education policy in particular. For example, the respected economist James Heckman and his colleagues have claimed (Garcia et al., 2016) that, for a certain early childhood intervention, “The overall rate of return is 13.7% per annum, and the benefit/cost ratio is 7.3.” That quoted sentence has two serious problems related to uncertainty and selection bias. To start with, it is an elementary but important error to have written that “the overall rate of return is . . . the benefit/cost ratio is . . .”; each instance of the word “is” in that sentence should immediately have been followed by “estimated at.” The next step is to recognize that selection on statistical significance induces biases in these estimates— and, given the small samples, high variabilities, and researcher degrees of freedom in the studies where the estimates came from, the biases could be huge (Gelman, 2017a). The report with its bold claims neither acknowledged this bias nor made any attempt to assess its magnitude.","PeriodicalId":47260,"journal":{"name":"Journal of Research on Educational Effectiveness","volume":" ","pages":""},"PeriodicalIF":1.8,"publicationDate":"2023-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48697239","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Strong Case for Rethinking Causal Inference","authors":"J. Deke","doi":"10.1080/19345747.2023.2203683","DOIUrl":"https://doi.org/10.1080/19345747.2023.2203683","url":null,"abstract":"","PeriodicalId":47260,"journal":{"name":"Journal of Research on Educational Effectiveness","volume":" ","pages":""},"PeriodicalIF":1.8,"publicationDate":"2023-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48569888","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Henry May, A. Blakeney, Pragya Shrestha, Mia Mazal, Nicole Kennedy
{"title":"Long-Term Impacts of Reading Recovery through 3rd and 4th Grade: A Regression Discontinuity Study","authors":"Henry May, A. Blakeney, Pragya Shrestha, Mia Mazal, Nicole Kennedy","doi":"10.1080/19345747.2023.2209092","DOIUrl":"https://doi.org/10.1080/19345747.2023.2209092","url":null,"abstract":"","PeriodicalId":47260,"journal":{"name":"Journal of Research on Educational Effectiveness","volume":" ","pages":""},"PeriodicalIF":1.8,"publicationDate":"2023-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41711873","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Knowledge Mobilization Framework: Toward Evidence-Based Statistical Communication Practices in Education Research","authors":"Kaitlyn G. Fitzgerald, Elizabeth Tipton","doi":"10.1080/19345747.2023.2209082","DOIUrl":"https://doi.org/10.1080/19345747.2023.2209082","url":null,"abstract":"","PeriodicalId":47260,"journal":{"name":"Journal of Research on Educational Effectiveness","volume":"56 1","pages":""},"PeriodicalIF":1.8,"publicationDate":"2023-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"60072081","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Adam M. Voight, Regina J. Giraldo‐García, L. Fogarty, Steven M. Sanders, Alexandrea R. Golden, M. Linick, Elisabeth Davis
{"title":"Directional Links Between Students’ Perceptions of School Climate and Academic Performance in Urban Schools","authors":"Adam M. Voight, Regina J. Giraldo‐García, L. Fogarty, Steven M. Sanders, Alexandrea R. Golden, M. Linick, Elisabeth Davis","doi":"10.1080/19345747.2023.2189895","DOIUrl":"https://doi.org/10.1080/19345747.2023.2189895","url":null,"abstract":"","PeriodicalId":47260,"journal":{"name":"Journal of Research on Educational Effectiveness","volume":" ","pages":""},"PeriodicalIF":1.8,"publicationDate":"2023-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43284195","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Item Response Theory Models for Difference-in-Difference Estimates (and Whether They Are Worth the Trouble)","authors":"J. Soland","doi":"10.1080/19345747.2023.2195413","DOIUrl":"https://doi.org/10.1080/19345747.2023.2195413","url":null,"abstract":"","PeriodicalId":47260,"journal":{"name":"Journal of Research on Educational Effectiveness","volume":" ","pages":""},"PeriodicalIF":1.8,"publicationDate":"2023-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42557315","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Supporting Teachers in Argument Writing Instruction at Scale: A Replication Study of the College, Career, and Community Writers Program (C3WP)","authors":"Nicole Arshan, C. Park, Rebecca Goetz","doi":"10.1080/19345747.2023.2179953","DOIUrl":"https://doi.org/10.1080/19345747.2023.2179953","url":null,"abstract":"","PeriodicalId":47260,"journal":{"name":"Journal of Research on Educational Effectiveness","volume":" ","pages":""},"PeriodicalIF":1.8,"publicationDate":"2023-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49464046","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}