{"title":"Comparing options for screening of reading difficulties in middle school: Do teacher ratings improve accuracy?","authors":"Eunsoo Cho, Courtenay A Barrett","doi":"10.1037/spq0000674","DOIUrl":"https://doi.org/10.1037/spq0000674","url":null,"abstract":"<p><p>Reading problems may emerge beyond the primary grades when the linguistic and cognitive demands of reading comprehension increase in middle school. The accurate identification of students requiring supplemental reading instruction is critical to provide remediation and decrease the prevalence and likelihood of reading problems in secondary settings and beyond. Nevertheless, research guidance on middle school reading screening is scarce. This study analyzed data from 193 sixth-grade students across 12 classrooms to examine (a) how well various reading screeners predicted proficiency on the year-end state assessment, (b) what combinations of reading screeners were most accurate, (c) the extent to which a brief teacher rating improved classification accuracy, and (d) the agreement rates between the most accurate combinations of screeners. Screeners included the Sight Word Efficiency, oral reading fluency (ORF), maze, and a multiple-choice reading comprehension (MCRC) assessment. Results from logistic regressions and receiver operating characteristic curve analyses suggested that no single screener was appropriate for use and that combinations of two or three screeners assessing different reading skills improved classification accuracy (i.e., ORF + MCRC, ORF + maze + MCRC). Moreover, teacher ratings further improved classification accuracy but its predictive value depended on the combination of screeners. Finally, there was a high agreement regarding which students were identified as needing intervention between these combinations of screeners. (PsycInfo Database Record (c) 2024 APA, all rights reserved).</p>","PeriodicalId":74763,"journal":{"name":"School psychology (Washington, D.C.)","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142634390","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Examining the impact of design-comparable effect size on the analysis of single-case design in special education.","authors":"Seth A King, Brendon Nylen, Olivia Enders, Lanqi Wang, Oluwatosin Opeoluwa","doi":"10.1037/spq0000628","DOIUrl":"10.1037/spq0000628","url":null,"abstract":"<p><p>Initially excluded from many evaluations of education research, single-case designs have recently received wider acceptance within and beyond special education. The growing approval of single-case design has coincided with an increasing departure from convention, such as the visual analysis of results, and the emphasis on effect sizes comparable with those associated with group designs. The use of design-comparable effect sizes by the What Works Clearinghouse has potential implications for the experimental literature in special education, which is largely composed of single-case designs that may not meet the assumptions required for statistical analysis. This study examined the compatibility of single-case design studies appearing in 33 special education journals with the design-comparable effect sizes and related assumptions described by the What Works Clearinghouse. Of the 1,425 randomly selected single-case design articles published from 1999 to 2021, 59.88% did not satisfy assumptions related to design, number of participants, or treatment replications. The rejection rate varied based on journal emphasis, with publications dedicated to students with developmental disabilities losing the largest proportion of articles. A description of the results follows a discussion of the implications for the interpretation of the evidence base. (PsycInfo Database Record (c) 2024 APA, all rights reserved).</p>","PeriodicalId":74763,"journal":{"name":"School psychology (Washington, D.C.)","volume":" ","pages":"601-612"},"PeriodicalIF":0.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140946685","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Alexandra M Pierce, Lisa M H Sanetti, Melissa A Collier-Meek, Austin H Johnson
{"title":"Evaluating the correspondence between expert visual analysis and quantitative methods.","authors":"Alexandra M Pierce, Lisa M H Sanetti, Melissa A Collier-Meek, Austin H Johnson","doi":"10.1037/spq0000644","DOIUrl":"10.1037/spq0000644","url":null,"abstract":"<p><p>Visual analysis is the primary methodology used to determine treatment effects from graphed single-case design data. Previous studies have demonstrated mixed findings related to interrater agreement between both expert and novice visual analysts, which represents a critical limitation of visual analysis and supports calls for also presenting statistical analyses (i.e., measures of effect size). However, few single-case design studies include results of both visual and quantitative analyses for the same set of data. The present study investigated whether blind review of single-case graphs constructed using up-to-date recommendations by experts in visual analysis would demonstrate adequate interrater agreement and have correspondence with an effect size metric, log response ratio. Eleven experts (i.e., professors in school psychology and special education with visual analysis experience) analyzed 26 multiple-baseline graphs evaluating implementation planning, a fidelity support, on educators' implementation and student outcomes, presented in a standardized format without indication of the variable being measured. Results suggest that there was strong correspondence between raters in their judgments of the presence or absence of treatment effects and meaningfulness of effects (particularly for graphs of adherence and quality). Additionally, a quadratic relationship was observed between aggregate results of expert visual analysis and effect size statistics. Implications for future research and limitations are discussed. (PsycInfo Database Record (c) 2024 APA, all rights reserved).</p>","PeriodicalId":74763,"journal":{"name":"School psychology (Washington, D.C.)","volume":" ","pages":"557-571"},"PeriodicalIF":0.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141763163","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Meta-analysis of single-case design research: Application of multilevel modeling.","authors":"Mikyung Shin, Stephanie L Hart, Michelle Simmons","doi":"10.1037/spq0000637","DOIUrl":"10.1037/spq0000637","url":null,"abstract":"<p><p>This study describes the benefits and challenges of meta-analyses of single-case design research using multilevel modeling. The researchers illustrate procedures for conducting meta-analyses using four-level multilevel modeling through open-source R code. The demonstration uses data from multiple-baseline or multiple-probe across-participant single-case design studies (<i>n</i> = 21) on word problem instruction for students with learning disabilities published between 1975 and 2023. Researchers explore changes in levels and trends between adjacent phases (baseline vs. intervention and intervention vs. maintenance) using the sample data. The researchers conclude that word problem solving of students with learning disabilities varies based on the complexity of the word problem measures involving single-word problem, mixed-word problem, and generalization questions. These moderating effects differed across adjacent phases. These findings extend previous literature on meta-analyses methodology by describing how multilevel modeling can be used to compare the impacts of time-varying predictors within and across cases when analyzing single-case design studies. Future researchers may want to use this methodology to explore the roles of time-varying predictors as well as case or study-level moderators. (PsycInfo Database Record (c) 2024 APA, all rights reserved).</p>","PeriodicalId":74763,"journal":{"name":"School psychology (Washington, D.C.)","volume":" ","pages":"625-635"},"PeriodicalIF":0.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141083036","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
MacKenzie D Sidwell, Landon W Bonner, Kayla Bates-Brantley, Marsha Hasenoehrl, Daniel L Gadke
{"title":"Single-case design emphasis in American Psychological Association-accredited school psychology programs.","authors":"MacKenzie D Sidwell, Landon W Bonner, Kayla Bates-Brantley, Marsha Hasenoehrl, Daniel L Gadke","doi":"10.1037/spq0000645","DOIUrl":"10.1037/spq0000645","url":null,"abstract":"<p><p>Single-case design (SCD) is an underutilized research methodology in school psychology literature. Despite its relevance to practitioners and applied intervention researchers alike, the majority of intervention research disseminated in school psychology journals tends to involve group designs, such as the randomized controlled trial. Group designs are useful for answering a wide variety of research questions but may not always be relevant to practitioners seeking procedures that work for their students or researchers seeking for the optimal design to answer their research questions. In comparison, the relative dearth of SCD studies in school psychology literature, in conjunction with common values among the field regarding data-based decision making and the scientist-practitioner model to training, raises questions about the cause of this gap. The present study sought to review doctoral training programs in school psychology and evaluate their relative emphasis on SCD in training. Seventy-six American Psychological Association-accredited school psychology programs were reviewed, and results indicated that roughly two thirds of programs do not emphasize SCD during training. Implications regarding school psychology training and research are discussed and recommendations are provided on future directions for school psychology trainers and researchers. (PsycInfo Database Record (c) 2024 APA, all rights reserved).</p>","PeriodicalId":74763,"journal":{"name":"School psychology (Washington, D.C.)","volume":" ","pages":"636-645"},"PeriodicalIF":0.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141636066","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Single-case design in school psychology: Issues of design, analysis, and training.","authors":"Evan H Dart, Keith C Radley","doi":"10.1037/spq0000682","DOIUrl":"https://doi.org/10.1037/spq0000682","url":null,"abstract":"<p><p>Single-case design (SCD) is a methodology that provides researchers with a rigorous means of evaluating interventions, yet it is often underutilized in school psychology. This introduction to a special issue highlights critical barriers to the broad use of SCD, including insufficient training, unclear reporting standards, and debates surrounding data analysis methods, such as visual and quantitative approaches. It also addresses how methodological issues, such as observer bias and improper data presentation, affect research outcomes. The special issue encompasses articles that explore these themes, aiming to advance SCD by examining training gaps, improving analytic strategies, and refining methodological guidelines. Collectively, these contributions seek to promote the broader adoption of SCD as a scientifically rigorous and practical research methodology in school psychology. (PsycInfo Database Record (c) 2024 APA, all rights reserved).</p>","PeriodicalId":74763,"journal":{"name":"School psychology (Washington, D.C.)","volume":"39 6","pages":"545-547"},"PeriodicalIF":0.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142857198","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Kathleen B Aspiranti, David M Hulac, Joseph H Hammer, Jessica Blake
{"title":"Reputable and affordable programs with a strong commitment to diversity: Factors influencing school psychology student admission decisions.","authors":"Kathleen B Aspiranti, David M Hulac, Joseph H Hammer, Jessica Blake","doi":"10.1037/spq0000579","DOIUrl":"10.1037/spq0000579","url":null,"abstract":"<p><p>A current issue in the field of school psychology is the extreme shortage of school psychologists, and this is likely to persist in the future. Effective recruitment into school psychology programs is one of the most important strategies to increase the number of school psychologists. Within the present study, researchers created the Graduate Enrollment Admissions Rating Scale (GEARS), a survey measuring several different factors that school psychology students consider when applying to graduate programs, to determine what factors contributed to school psychology students' choice of program. The GEARS was sent via email to current school psychology graduate students. Overall, current students rated program quality, including faculty friendliness, as the most important factor influencing their decision. Second, considerations reflecting the program cost were influential. Diversity issues were the third most important factor in students choosing their school psychology programs. Costs and research/teaching opportunities were more important in the recruitment of doctoral students than specialist students, but specialist students valued convenience of a program more than doctoral students. Results of this study suggest that faculty members in charge of recruiting need to consider ways to manage tuition costs, develop relationships with future students, and strive toward high-quality programs as the best ways to increase the likelihood that students will attend their university. (PsycInfo Database Record (c) 2024 APA, all rights reserved).</p>","PeriodicalId":74763,"journal":{"name":"School psychology (Washington, D.C.)","volume":" ","pages":"702-710"},"PeriodicalIF":0.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71415846","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Correlates of social justice values in school psychology graduate students.","authors":"Celeste M Malone, MyLea Barclift","doi":"10.1037/spq0000572","DOIUrl":"10.1037/spq0000572","url":null,"abstract":"<p><p>School psychologists are well-positioned to serve as advocates for marginalized students to address educational inequities and challenge systemic barriers to well-being. However, if they do not personally endorse social justice values, they may be unwilling to take personal and professional risks to engage in social justice work. The purpose of this study was to examine the extent to which personal characteristics and multicultural competence are associated with social justice values in school psychology graduate students. A sample of 108 graduate students completed the Social Justice Scale, School Psychology Multicultural Competence Scale, and Marlowe-Crowne Social Desirability Scale. Participants strongly endorsed having social justice values; however, they were less likely to report being in a context supportive of social justice work. There was no difference in reported social justice values based on gender or race; however, sexual marginalized students and those with very liberal political ideology reported more positive attitudes toward social justice. Students with very liberal political ideology also reported greater intent to engage in social justice actions in the future. Additionally, there were several positive correlations between social justice values and perceived multicultural competence. Multicultural competence accounted for most of the variance in participants' perceived ability to engage in social justice actions and being in environments supportive of social justice, while personal characteristics explained most of the variance in participants' intent to engage in future social justice actions. Notably, political ideology was the most consistent predictor of social justice values. Findings and implications for graduate education programs are discussed. (PsycInfo Database Record (c) 2024 APA, all rights reserved).</p>","PeriodicalId":74763,"journal":{"name":"School psychology (Washington, D.C.)","volume":" ","pages":"691-701"},"PeriodicalIF":0.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10015119","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Austin H Johnson, Celeste M Malone, Tara C Raines, Tyler A Womack, Bhawandeep K Bains
{"title":"Characteristics of school psychology faculty in 2021.","authors":"Austin H Johnson, Celeste M Malone, Tara C Raines, Tyler A Womack, Bhawandeep K Bains","doi":"10.1037/spq0000578","DOIUrl":"10.1037/spq0000578","url":null,"abstract":"<p><p>Although racial, ethnic, and linguistically minoritized school-aged students within the United States are increasing in population, school psychologists have historically been predominantly white, monolingual females. Diversity within the field of school psychology is important for improving students' achievement and postsecondary success, particularly as it relates to underrepresented students. Research shows that the diversity of school psychology faculty is important for the recruitment and retention of minoritized graduate students. However, demographic information within school psychology has only been calculated within the context of memberships to psychological organizations (e.g., the National Association of School Psychologists), which could underestimate the actual diversity of school psychology faculty currently in the profession. The purpose of this study was to collect information on the demographic characteristics of school psychology faculty as of 2021. A total of 429 school psychology trainers completed a brief web-based survey in which they self-identified their employment characteristics, gender identity, sexual orientation, racial-ethnic identity, (dis)ability status, and languages spoken. At the time of the survey, most of the sample were employed as full professors (30.5%) or assistant professors (29.4%). Results demonstrated that majority of the sample identified as white (78.6%), cisgender female (66.2%), heterosexual (87.2%), non(dis)abled (95.1%), and monolingual English speaking (83.9%). Faculty of color were more likely to report a higher percentage of time spent teaching as compared to white faculty. Implications of these findings and future directions are discussed. (PsycInfo Database Record (c) 2024 APA, all rights reserved).</p>","PeriodicalId":74763,"journal":{"name":"School psychology (Washington, D.C.)","volume":" ","pages":"719-724"},"PeriodicalIF":0.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10154018","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The effect of the level of data presentation on visual analysts' decisions.","authors":"Keith C Radley, Evan H Dart","doi":"10.1037/spq0000656","DOIUrl":"10.1037/spq0000656","url":null,"abstract":"<p><p>Single-case design (SCD) is frequently utilized in research and applied settings to evaluate the effect of an intervention over time. Once collected, single-case data are typically graphed and analyzed visually in both research and practice contexts. Despite the ubiquity of visual analysis in SCD, this analytic framework has often been critiqued due to findings of limited reliability across visual analysts. Recent research has identified that the way a graph is constructed may contribute to the limitations of visual analysis. The present study sought to evaluate the effect of visually representing multiple measurement occasions as a single data point (e.g., combining measurements taken daily into a weekly composite data point) on visual analysts' decisions regarding the magnitude of an intervention effect. Eleven participants viewed identical data sets, plotted to show different numbers of measurement occasions combined as a single data point, and provided ratings regarding the magnitude of intervention effect depicted within the graph. Results indicated a significant main effect, with data sets with higher levels of data combination being rated as demonstrating significantly larger intervention effects. The results of the study provide additional support for standardization of data presentation and graph construction within SCD in both research and practice contexts. (PsycInfo Database Record (c) 2024 APA, all rights reserved).</p>","PeriodicalId":74763,"journal":{"name":"School psychology (Washington, D.C.)","volume":" ","pages":"572-578"},"PeriodicalIF":0.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141636067","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}