{"title":"Centering Student Voice in Developing Learning Analytics and Artificial Intelligence–Embedded Supports","authors":"Emily Oakes, Yih Tsao, Victor Borden","doi":"10.34315/apf1622023","DOIUrl":"https://doi.org/10.34315/apf1622023","url":null,"abstract":"Accelerating advancements in learning analytics and artificial intelligence (AI) offers unprecedented opportunities for improving educational experiences. Without including students’ perspectives, however, there is a potential for these advancements to inadvertently marginalize or harm the very individuals these technologies aim to support. This article underscores the risks associated with sidelining student voices in decision-making processes related to their data usage. By grounding data use within a social justice framework, we advocate for a more equitable and holistic approach. Drawing on previous research as well as insights we have gathered from a student panel, we outline effective methods to integrate student voices. We conclude by emphasizing the long-term implications for the institutional research field, arguing for a shift toward more inclusive and student-centric practices in the realm of learning analytics and AI-embedded supports.","PeriodicalId":267348,"journal":{"name":"AIR Professional File","volume":"250 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139170120","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Advising at Scale: Automated Guidance of the Role Players Influencing Student Success","authors":"R. Rawatlal, R. Dhunpath","doi":"10.34315/apf1632023","DOIUrl":"https://doi.org/10.34315/apf1632023","url":null,"abstract":"Although student advising is known to improve student success, its application is often inadequate in institutions that are resource constrained. Given recent advances in large language models (LLMs) such as Chat Generative Pre-trained Transformer (ChatGPT), automated approaches such as the AutoScholar Advisor system affords viable alternatives to conventional modes of advising at scale. This article focuses on the AutoScholar Advisor system, a system that continuously analyzes data using modern methods from the fields of artificial intelligence (AI), data science, and statistics. The system connects to institutional records, evaluates a student’s progression, and generates advice accordingly. In addition to serving large numbers of students, the term “advising at scale” refers to the various role players: the executives (whole-institution level), academic program managers (faculty and discipline levels), student advisors (faculty level), lecturers (class level), and, of course, the students (student level). The form of advising may also evolve to include gamification elements such as points, badges, and leaderboards to promote student activity levels. Case studies for the integration with academic study content in the form of learning pathways are presented. We therefore conclude with the proposition that the optimal approach to advising is a hybrid between human intervention and automation, where the automation augments human judgment.","PeriodicalId":267348,"journal":{"name":"AIR Professional File","volume":"712 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139169928","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Predictive Analytics in Higher Education: The Promises and Challenges of Using Machine Learning to Improve Student Success","authors":"Kelli Bird","doi":"10.34315/apf1612023","DOIUrl":"https://doi.org/10.34315/apf1612023","url":null,"abstract":"Colleges are increasingly turning to predictive analytics to identify “at-risk” students in order to target additional supports. While recent research demonstrates that the types of prediction models in use are reasonably accurate at identifying students who will eventually succeed or not, there are several other considerations for the successful and sustained implementation of these strategies. In this article, I discuss the potential challenges to using risk modeling in higher education and suggest next steps for research and practice.","PeriodicalId":267348,"journal":{"name":"AIR Professional File","volume":"7 14","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139168908","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Reflections on the Artificial Intelligence Transformation: Responsible Use and the Role of Institutional Research and Institutional Effectiveness Professionals","authors":"Mike Urmeneta","doi":"10.34315/apf1642023","DOIUrl":"https://doi.org/10.34315/apf1642023","url":null,"abstract":"This article explores the potential impact of artificial intelligence (AI) and machine learning on higher education. It overviews current generative AI capabilities and argues for ethical frameworks to address issues such as bias. The article advocates for a multidisciplinary governance approach involving institutional stakeholders by examining past academic technology adoption. It highlights the strategic role institutional research (IR) and institutional effectiveness (IE) professionals can play in navigating AI complexities. This article provides specific suggestions for IR/IE professionals to embrace the role of AI ethicist: continuously developing AI literacy, ensuring ethical deployment, upholding privacy and confidentiality, mitigating bias, enforcing accountability, championing explainable AI, incorporating student perspectives, and developing institutional AI policies. The article concludes by asserting that IR/IE’s research expertise, ethical commitment, and belief in human judgment equip the field to adapt to and lead in the AI era. By taking an active role, IR/IE can shape the technology’s impact to benefit higher education.","PeriodicalId":267348,"journal":{"name":"AIR Professional File","volume":"27 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139169019","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Process Tracing for the Institutional Researcher","authors":"Haroon Atcha","doi":"10.34315/apf1572022","DOIUrl":"https://doi.org/10.34315/apf1572022","url":null,"abstract":"Institutional researchers are often tasked with assessing why college-wide initiatives succeed or fail. This can be a difficult task: researchers need to discriminate between multiple feasible explanations, work with limited data, and produce compelling narratives. Process tracing is a qualitative methodology that enables researchers to make valid inferences in such circumstances. Process tracing focuses the researcher’s attention on the sequence connecting cause and effect. It involves articulating a working theory, generating hypotheses, collecting data, assessing competing hypotheses, revising theory, and producing a narrative connecting cause and effect. This paper describes how to use process tracing for institutional research. It begins by summarizing key concepts, uses a simulated case study to give a brief overview of process tracing, discusses the importance of evidence and transparency in implementing the method, and concludes with a summary of the benefits of process tracing.","PeriodicalId":267348,"journal":{"name":"AIR Professional File","volume":"95 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114566672","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
P. Sturgis, Leslie Marchand, M. Miller, Wei Xu, A. Castiglioni
{"title":"Generalizability Theory and Its Application to Institutional Research","authors":"P. Sturgis, Leslie Marchand, M. Miller, Wei Xu, A. Castiglioni","doi":"10.34315/apf1562022","DOIUrl":"https://doi.org/10.34315/apf1562022","url":null,"abstract":"This article introduces generalizability theory (G-theory) to institutional research and assessment practitioners, and explains how it can be utilized to evaluate the reliability of assessment procedures in order to improve student learning outcomes. The fundamental concepts associated with G-theory are briefly discussed, followed by a discussion of the software needed to conduct a generalizability study (G-study) analysis. The article then presents a case study of a G-study analysis; this case study was conducted in order to evaluate the generalizability and dependability of an exam that third-year medical school students complete. The conclusion discusses several situations that institutional research and assessment practitioners are likely to encounter where G-theory can be used to evaluate and improve their assessment procedures in pursuit of improving student learning outcomes.","PeriodicalId":267348,"journal":{"name":"AIR Professional File","volume":"50 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114209007","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Methodological Approach to Selective Cutbacks","authors":"Charles H. Bélanger, Lise Tremblay","doi":"10.34315/apf0141983","DOIUrl":"https://doi.org/10.34315/apf0141983","url":null,"abstract":"Budget cuts have become less and less a news item as postsecondary institutions around the world have increasingly become targets of local and national governments trying to patch up faltering economies. In a survey of European universities conducted by the Organization for Economic Cooperation and Development (OECD), participating institutions were unanimous in deploring both the regression of consumable financial means and the budget decline, worsened by an overproportional increase in personnel costs (Bender & Henning, 1980). At the United Kingdom's forty-five universities, some administrators in the spring of 1981 were privately toying with the idea of asking faculty members to take voluntary pay cuts to avoid massive layoffs (Walker, 1981). The situation was not less severe in North American institutions. Many American legislatures had forced universities to operate with huge deficits and to declare a state of financial emergency (Magarrell, 1981; Watkins, 1981). Canadian provincial and federal governments also were being accused of having added colleges and universities to their \"hit list\" (Winter, 1981).","PeriodicalId":267348,"journal":{"name":"AIR Professional File","volume":"274 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1982-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122764984","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Rethinking Completion Analytics to Better Support the Student Experience across Diverse Ecosystems","authors":"J. Cornett","doi":"10.34315/apf1502020","DOIUrl":"https://doi.org/10.34315/apf1502020","url":null,"abstract":"This research would not have been possible without the kind and thoughtful support of several people. I thank Dr. Sanford Shugart, president of Valencia College, for teaching me to value the student experience and the importance of finding ways to measure it. I am grateful to Dr. Sue Ellspermann, president of Ivy Tech Community College of Indiana for encouraging me to publish this article, and for allowing me to reveal all the Ivy Tech Central Indiana data shown in this paper.1 Finally, Stephen Hancock earns my thanks for devoting several years of his career to building our CAT-scan data mart. This was an incredibly time-consuming and frustrating task since I continually added more layers to the CATscan graphs. Abstract","PeriodicalId":267348,"journal":{"name":"AIR Professional File","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125098344","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Coping with Curricular Change in Academe","authors":"G. Melchiori","doi":"10.34315/apf0091981","DOIUrl":"https://doi.org/10.34315/apf0091981","url":null,"abstract":"After years of curricular proliferation and an expectation of continuing growth in funding, the socioeconomic and demographic conditions warranting program expansion may have ceased to exist for most American colleges and universities. Predictions for the 1980s seem to indicate that academic renewal, changes, and additions need to occur within constant, if not decreasing, resources. Thus, in view of the goal of retaining curricular flexibility and providing conditions for academic change for the next decade, reasons to reduce or discontinue academic programs of poor quality, low productivity, or questionable centrality are pervasive. While much attention has been placed on institutionally initiated program closures, relatively little research has been geared toward assessing the role and efforts of agencies for higher education in initiating and implementing curricular change in general and reductions in particular.","PeriodicalId":267348,"journal":{"name":"AIR Professional File","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130397753","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Andrea Chambers, Hollie Daniels, John Dooris, Arlyn Y. Moreno Luna, Sean Riordan
{"title":"Does the Starting Point Matter? Analyzing Bachelor’s Degree Attainment for Adult Students by Institutional Type","authors":"Andrea Chambers, Hollie Daniels, John Dooris, Arlyn Y. Moreno Luna, Sean Riordan","doi":"10.34315/apf1582023","DOIUrl":"https://doi.org/10.34315/apf1582023","url":null,"abstract":"Using the National Center for Education Statistics (NCES) 2012/17 Beginning Postsecondary Students Longitudinal Study (BPS:12/17), this research study explores the persistence to bachelor’s degree attainment of adult students. Specifically, this study looks at adult students who expected to earn a bachelor’s degree or higher, and analyzes whether those students who begin their postsecondary education at a 2-year public or private nonprofit institution are more or less likely to attain a bachelor’s degree compared to adult students who begin at a 4-year public or 4-year private nonprofit institution. Our findings indicate that, after controlling for common predictors of persistence such as high school GPA, receipt of Pell Grants, and other demographic data, adult students who begin at a 2-year public or private nonprofit institution are no less likely to attain a bachelor’s degree compared to adult students who start at a 4-year public institution. In addition, full-time enrollment intensity does not increase the odds of persistence compared to mixed enrollment intensity for adult students.","PeriodicalId":267348,"journal":{"name":"AIR Professional File","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115847193","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}