ACM Transactions on Computing Education最新文献

筛选
英文 中文
Automated Grading and Feedback Tools for Programming Education: A Systematic Review 编程教育的自动评分和反馈工具:系统回顾
IF 2.4 3区 工程技术
ACM Transactions on Computing Education Pub Date : 2023-12-13 DOI: 10.1145/3636515
Marcus Messer, Neil C. C. Brown, Michael Kölling, Miaojing Shi
{"title":"Automated Grading and Feedback Tools for Programming Education: A Systematic Review","authors":"Marcus Messer, Neil C. C. Brown, Michael Kölling, Miaojing Shi","doi":"10.1145/3636515","DOIUrl":"https://doi.org/10.1145/3636515","url":null,"abstract":"<p>We conducted a systematic literature review on automated grading and feedback tools for programming education. We analysed 121 research papers from 2017 to 2021 inclusive and categorised them based on skills assessed, approach, language paradigm, degree of automation and evaluation techniques. Most papers assess the correctness of assignments in object-oriented languages. Typically, these tools use a dynamic technique, primarily unit testing, to provide grades and feedback to the students or static analysis techniques to compare a submission with a reference solution or with a set of correct student submissions. However, these techniques’ feedback is often limited to whether the unit tests have passed or failed, the expected and actual output, or how they differ from the reference solution. Furthermore, few tools assess the maintainability, readability or documentation of the source code, with most using static analysis techniques, such as code quality metrics, in conjunction with grading correctness. Additionally, we found that most tools offered fully automated assessment to allow for near-instantaneous feedback and multiple resubmissions, which can increase student satisfaction and provide them with more opportunities to succeed. In terms of techniques used to evaluate the tools’ performance, most papers primarily use student surveys or compare the automatic assessment tools to grades or feedback provided by human graders. However, because the evaluation dataset is frequently unavailable, it is more difficult to reproduce results and compare tools to a collection of common assignments.</p>","PeriodicalId":48764,"journal":{"name":"ACM Transactions on Computing Education","volume":"3 1","pages":""},"PeriodicalIF":2.4,"publicationDate":"2023-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138581218","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
You’re Hired! A Phenomenographic Study of Undergraduate Students’ Pathways to Job Attainment in Computing 你被录用了计算机专业本科生就业途径的现象学研究
IF 2.4 3区 工程技术
ACM Transactions on Computing Education Pub Date : 2023-12-09 DOI: 10.1145/3636514
Stephanie Jill Lunn, Ellen Zerbe, Monique Ross
{"title":"You’re Hired! A Phenomenographic Study of Undergraduate Students’ Pathways to Job Attainment in Computing","authors":"Stephanie Jill Lunn, Ellen Zerbe, Monique Ross","doi":"10.1145/3636514","DOIUrl":"https://doi.org/10.1145/3636514","url":null,"abstract":"Although there is a great demand for graduates in computing fields, companies frequently struggle to find enough workers. They may also grapple with obtaining racial, ethnic, and gender diversity in representation. It has been suggested that the hiring process further contributes to these inequities. This study examined undergraduate computing students’ experiences with technical interviews and their pathways to job attainment, focusing on men and women who identify as Black or African American, Hispanic or Latinx, Asian, and mixed-race. We applied the community cultural wealth framework and employed the methodology of phenomenography to investigate the different assets that students leveraged to succeed in obtaining a position. Our investigation centered around the conceptions of sixteen computing students, all of whom completed at least one technical interview and received at least one job offer. We conducted semi-structured interviews to explore their interpretations of the hiring process, the resources they utilized, and their perceptions of inclusivity in the field. The findings illustrated that students’ support mechanisms included the following categories of description: intrinsic characteristics, capitalizing on experience, community, preparation, and organizational. They relied heavily on distinct forms of capital, particularly social and navigational, to attain a job in computing. Peers and clubs or groups were essential for students to learn about what to expect during the hiring process, to help them prepare, and to make connections with employers. They also helped the students cope with the discrimination they faced throughout their professional trajectories. By investigating the various experiences students have, we contribute to the understanding of how hiring practices may be viewed as well as possible ways to provide support. While students must study for technical interviews and refine their skills and pertinacity in the face of obstacles, industry and academia should consider their role in hiring and its impact. Transparency in what to expect and enhanced preparation opportunities could serve to make the process more equitable for all job candidates.","PeriodicalId":48764,"journal":{"name":"ACM Transactions on Computing Education","volume":"167 1","pages":""},"PeriodicalIF":2.4,"publicationDate":"2023-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138561081","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
CS=Me: Exploring Factors that Shape Black Women's CS Identity at the Intersections of Race and Gender CS=我:探索在种族和性别交叉点上形成黑人妇女 CS 身份的因素
IF 2.4 3区 工程技术
ACM Transactions on Computing Education Pub Date : 2023-12-08 DOI: 10.1145/3631715
Krystal L. Williams, Edward Dillon, Shanice Carter, Janelle Jones, Shelly Melchior
{"title":"CS=Me: Exploring Factors that Shape Black Women's CS Identity at the Intersections of Race and Gender","authors":"Krystal L. Williams, Edward Dillon, Shanice Carter, Janelle Jones, Shelly Melchior","doi":"10.1145/3631715","DOIUrl":"https://doi.org/10.1145/3631715","url":null,"abstract":"<p>Improving equity and inclusion for underrepresented groups in the field of Computer Science (CS) has garnered much attention. In particular, there is a longstanding need for diversity efforts that center the experiences of Black women, and specific actions to increase their representation—especially given the biases that they often encounter in the field. There is limited research concerning Black women in CS, specifically their conceptions of the field and their overarching CS identity development. More research in this area is especially important given the marginalization that Black women often experience at the intersections of their race and gender. Guided by a combination of critical theoretical lenses, this qualitative study examines Black women's conceptions of what it means to be a Computer Scientist and the degree to which those conceptions map onto how they see themselves in the field. Moreover, we explore experiences that help to bolster Black women's CS identity. The findings highlight key aspects of what it means to be a Computer Scientist for the Black women in this study—notably the ability to use computing to make societal contributions. Also, the results accentuate key nuances in the participants’ personal CS identification, particularly as it relates to the resilience required to overcome unique barriers that many Black women encounter when engaging within the field. Moreover, the findings highlight the importance of social support systems to facilitate Black women's CS identity development. Implications for policy and practice within education and industry are discussed.</p>","PeriodicalId":48764,"journal":{"name":"ACM Transactions on Computing Education","volume":"50 1","pages":""},"PeriodicalIF":2.4,"publicationDate":"2023-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138552821","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
What Learning Strategies are Used by Programming Students? A Qualitative Study Grounded on the Self-regulation of Learning Theory 编程学生使用什么学习策略?基于学习自我调节理论的定性研究
IF 2.4 3区 工程技术
ACM Transactions on Computing Education Pub Date : 2023-12-06 DOI: 10.1145/3635720
Leonardo Silva, António Mendes, Anabela Gomes, Gabriel Fortes
{"title":"What Learning Strategies are Used by Programming Students? A Qualitative Study Grounded on the Self-regulation of Learning Theory","authors":"Leonardo Silva, António Mendes, Anabela Gomes, Gabriel Fortes","doi":"10.1145/3635720","DOIUrl":"https://doi.org/10.1145/3635720","url":null,"abstract":"<p>Self-regulation of learning (SRL) is an essential ability for academic success in multiple educational contexts, including programming education. However, understanding how students regulate themselves during programming learning is still limited. This exploratory research aimed to investigate the regulatory strategies externalized by 51 students enrolled in an introductory programming course. The objective was to identify the SRL strategies used by these students during multiple phases of the learning process and compare the SRL behavior of high and low-performers. The following research questions guided this investigation: RQ1) What regulation of learning strategies are used by programming students?; and RQ2) How do the SRL strategies used by high and low-performing students differ?. The findings demonstrate that learning to program involves complex psychological resources (e.g., cognition, metacognition, behavior, motivation, and emotion) and that students present heterogeneity in their SRL repertoire. In addition, high and low-performing students showed significant differences in how they regulate, which can contribute to understanding the factors that may contribute to learning programming. Lastly, we argue that for analyzing SRL strategies, it is necessary to consider the specificities of programming education, which motivated the development of a conceptual framework to describe the identified strategies and regulatory phases in this learning domain.</p>","PeriodicalId":48764,"journal":{"name":"ACM Transactions on Computing Education","volume":" 9","pages":""},"PeriodicalIF":2.4,"publicationDate":"2023-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138493138","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Important Role Social Capital Plays in Navigating the Computing Education Ecosystem for Black Girls 社会资本在引导黑人女孩计算机教育生态系统中的重要作用
IF 2.4 3区 工程技术
ACM Transactions on Computing Education Pub Date : 2023-11-30 DOI: 10.1145/3632295
Camille Ferguson, Vanora Thomas, Juan Del Toro, Daniel Light, Kamau Bobb, Peta-Gay Clarke, Shameeka Emanuel, Ed Gronke, Mary Jo Madda, Imani Jennings
{"title":"The Important Role Social Capital Plays in Navigating the Computing Education Ecosystem for Black Girls","authors":"Camille Ferguson, Vanora Thomas, Juan Del Toro, Daniel Light, Kamau Bobb, Peta-Gay Clarke, Shameeka Emanuel, Ed Gronke, Mary Jo Madda, Imani Jennings","doi":"10.1145/3632295","DOIUrl":"https://doi.org/10.1145/3632295","url":null,"abstract":"&lt;p&gt;Black women represent the greatest underrepresentation in STEM fields—and in particular, the technology sector. According to a 2015 article in The Verge, Black women make up between 0 to 7% of the staff at the eight largest technology firms in the United States [1]. This points to a glaring problem in terms of equity and inclusivity in the technology sector. Similar to their underrepresentation in the STEM sector, Black women's underrepresentation in the tech sector is related to pervasive and persistent prejudice and biased policies that endure in the U.S. which have limited—and continue to limit—their access to quality education and spaces where Black women's cultural capital (i.e., ways of being) is acknowledged and appreciated. For most people, including Black women, social networks often make available opportunities and pathways towards realizing the roles they can play in the world or a particular industry [2][3]. These webs of relationships and the embedded quality in them can be defined as an individual's social capital and be applied to any industry, including STEM and technology fields [4]. In a practical sense, social capital allows an individual to leverage relationships for resources (such as information about internships and jobs or encouragement to persist through a difficult college course). In turn, these resources can contribute to economic opportunities (i.e., jobs) or social opportunities, such as relationships with gatekeepers who work in STEM fields that may lead to opportunities like jobs, projects, or financial backing.&lt;/p&gt;&lt;p&gt;Research suggests that the social networks of Black young women rarely overlap with the networks of predominantly white and Asian males, who are overrepresented in the technology field. This weakens Black women's awareness of opportunities and training, and undermines their motivation to persist in the STEM sector [5][6]. As a result of this increasing understanding of the role of social capital in career development, K–12 and higher education programs that are focused on equity in STEM fields have increasingly turned to the concept of social capital to address the traditional underrepresentation of certain groups—in particular, Blacks, Latinos, and women in STEM fields [4][5][6][7][8]. The following research investigates the experiences of Black girls who attended a program, Google's Code Next, designed to engage Black and Latinx youth in computer science (CS). We argue that it is crucial for CS programs not just to teach hard coding skills, but also to build on young Black women's social capital to accommodate the young women in creating and expanding their tech social capital, enabling them to successfully navigate STEM and technology education and career pathways. Specifically, this paper explores a sub-program of Code Next and how it has contributed to young Black women's persistence in STEM, and particularly in technology. The findings suggest that the young women employed an expanded sense o","PeriodicalId":48764,"journal":{"name":"ACM Transactions on Computing Education","volume":"71 6","pages":""},"PeriodicalIF":2.4,"publicationDate":"2023-11-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138516875","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Teaching Ethics in Computing: A Systematic Literature Review of ACM Computer Science Education Publications 计算机教学伦理:美国计算机学会计算机科学教育出版物的系统文献综述
IF 2.4 3区 工程技术
ACM Transactions on Computing Education Pub Date : 2023-11-27 DOI: 10.1145/3634685
Noelle Brown, Benjamin Xie, Ella Sarder, Casey Fiesler, Eliane S. Wiese
{"title":"Teaching Ethics in Computing: A Systematic Literature Review of ACM Computer Science Education Publications","authors":"Noelle Brown, Benjamin Xie, Ella Sarder, Casey Fiesler, Eliane S. Wiese","doi":"10.1145/3634685","DOIUrl":"https://doi.org/10.1145/3634685","url":null,"abstract":"<p>The computing education research community now has at least 40 years of published research on teaching ethics in higher education. To examine the state of our field, we present a systematic literature review of papers in the Association for Computing Machinery (ACM) computing education venues that describe teaching ethics in higher-education computing courses. Our review spans all papers published to SIGCSE, ICER, ITiCSE, CompEd, Koli Calling, and TOCE venues through 2022, with 100 papers fulfilling our inclusion criteria. Overall, we found a wide variety in content, teaching strategies, challenges, and recommendations. The majority of the papers did not articulate a conception of “ethics,” and those that did used many different conceptions, from broadly-applicable ethical theories, to social impact, to specific computing application areas (e.g., data privacy, hacking). Instructors used many different pedagogical strategies (e.g., discussions, lectures, assignments) and formats (e.g., standalone courses, incorporated within a technical course). Many papers identified measuring student knowledge as a particular challenge, and 59% of papers included mention of assessments or grading. Of the 69% of papers that evaluated their ethics instruction, most used student self-report surveys, course evaluations, and instructor reflections. While many papers included calls for more ethics content in computing, specific recommendations were rarely broadly applicable, preventing a synthesis of guidelines. To continue building on the last 40 years of research and move toward a set of best practices for teaching ethics in computing, our community should delineate our varied conceptions of ethics, examine which teaching strategies are best suited for each, and explore how to measure student learning.</p>","PeriodicalId":48764,"journal":{"name":"ACM Transactions on Computing Education","volume":"54 1","pages":""},"PeriodicalIF":2.4,"publicationDate":"2023-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138516867","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Outsiders Within: How Do Black Girls Fit Into Computer Science for All? 局外人:黑人女孩如何适合所有人的计算机科学?
IF 2.4 3区 工程技术
ACM Transactions on Computing Education Pub Date : 2023-11-21 DOI: 10.1145/3633464
Zitsi Mirakhur, Cheri Fancsali, Kathryn Hill
{"title":"Outsiders Within: How Do Black Girls Fit Into Computer Science for All?","authors":"Zitsi Mirakhur, Cheri Fancsali, Kathryn Hill","doi":"10.1145/3633464","DOIUrl":"https://doi.org/10.1145/3633464","url":null,"abstract":"<p><b>Objectives</b>. At the K-12 level, “CS for All” initiatives across the country strive to increase equitable access to and participation in computer science (CS). However, there are many open questions about the implementation and effectiveness of these initiatives, including the extent to which exposing young people to CS early on can shape their longer-term CS interest and engagement. In this paper, we examine CS participation among 6<sup>th</sup>-8<sup>th</sup> grade Black girls—and assess whether CS participation during middle school shapes CS interest and engagement during their first year of high school. We focus on Black girls in the hopes of developing a more nuanced and rigorous understanding of computing experiences at the intersection of racism and sexism in this field.</p><p><b>Participants</b>. The focal group of students in this study are 6<sup>th</sup>-8<sup>th</sup> grade Black girls from New York City. We employ a comparative lens in this paper, contextualizing the CS experiences and outcomes of Black girls to Latinas, Asian, and White girls, as well as Black boys.</p><p><b>Study Method</b>. We primarily rely on quantitative data for this paper, applying a critical lens to our analyses and interpretation. More specifically, we conduct descriptive analyses of course-taking patterns as well as survey data that focus on student attitudes and beliefs about CS. We then carry out inferential analyses of students’ administrative records examining how, if at all, middle school CS participation is related to high school outcomes for Black girls. We employ a comparative lens and rely on qualitative data to make sense of our results.</p><p><b>Findings</b>. We find that, troublingly, Black girls in the district are disproportionately less likely to receive CS instruction in middle school. Black girls are also less likely than Black boys, Latinas, and White girls to feel that they belong in CS. However, Black girls in CS courses report similar levels of engagement, family, and peer support, as well as value for CS relative to other students in the district. Finally, we find that participation in CS courses in middle school does not increase the likelihood that Black girls will select high schools that offer CS courses or take a CS course during their first year of high school.</p><p><b>Conclusions</b>. Our findings suggest that to increase equitable access and participation in CS, it is not enough to simply expose students to CS coursework. We call for sustained attention to the experiences that Black girls have in their CS classes as well as broader structural barriers that might shape CS course-taking.</p>","PeriodicalId":48764,"journal":{"name":"ACM Transactions on Computing Education","volume":"35 7","pages":""},"PeriodicalIF":2.4,"publicationDate":"2023-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138503006","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Factors That Predict K-12 Teachers' Ability to Apply Computational Thinking Skills 预测K-12教师应用计算思维技能能力的因素
IF 2.4 3区 工程技术
ACM Transactions on Computing Education Pub Date : 2023-11-21 DOI: 10.1145/3633205
Deepti Tagare
{"title":"Factors That Predict K-12 Teachers' Ability to Apply Computational Thinking Skills","authors":"Deepti Tagare","doi":"10.1145/3633205","DOIUrl":"https://doi.org/10.1145/3633205","url":null,"abstract":"<p><b>Background and Objective</b>. Teacher assessment research suggests that teachers have good conceptual understanding of CT. However, to model CT based problem-solving in their classrooms, teachers need to develop the ability to recognize when and how to apply CT skills. Does existing professional development (PD) equip teachers to know when and how to apply CT skills? What factors should PD providers consider while developing trainings for CT application skills?</p><p><b>Method</b>. This retrospective observational study used a binomial regression model to determine what factors predict teachers’ probability of performing well on a CT application skills test.</p><p><b>Participants</b>. Participants of this study were 129 in-service K-12 teachers from a community of practice in India.</p><p><b>Findings</b>. Results show that teachers who have received at least one CT training, who have a higher teaching experience, and are currently teaching CT will have a higher probability of applying CT skills correctly to problems irrespective of the subject they teach and their educational backgrounds. However, receiving higher number of CT PD trainings was a negative predictor of teachers’ performance.</p><p><b>Implications</b>. Implications for school administrators, professional development providers, and researchers are discussed. Teachers need ample opportunity to teach CT in their teaching schedules. Continuous professional development does not necessarily result in improved CT application skills unless careful consideration is given to the pedagogies used and to the resolution of misconceptions that teachers may have developed in prior training. Mixing plugged and unplugged pedagogical approaches may be beneficial to encourage transfer of CT application skills across different types of problems. Lastly, there is a need to develop valid and reliable instruments that measure CT application skills of teachers.</p>","PeriodicalId":48764,"journal":{"name":"ACM Transactions on Computing Education","volume":"35 5","pages":""},"PeriodicalIF":2.4,"publicationDate":"2023-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138503008","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
School of Computing and Communications, The Open University, Milton Keynes, MK7 6AA, UK 英国开放大学计算与通信学院,米尔顿凯恩斯,MK7 6AA
IF 2.4 3区 工程技术
ACM Transactions on Computing Education Pub Date : 2023-11-21 DOI: 10.1145/3633287
Kevin Waugh, Mark Slaymaker, Marian Petre, John Woodthorpe, Daniel Gooch
{"title":"School of Computing and Communications, The Open University, Milton Keynes, MK7 6AA, UK","authors":"Kevin Waugh, Mark Slaymaker, Marian Petre, John Woodthorpe, Daniel Gooch","doi":"10.1145/3633287","DOIUrl":"https://doi.org/10.1145/3633287","url":null,"abstract":"<p>Cheating has been a long standing issue in university assessments. However, the release of ChatGPT and other free-to-use generative AI tools have provided a new and distinct method for cheating. Students can run many assessment questions through the tool and generate a superficially compelling answer, which may or may not be accurate. We ran a dual-anonymous “quality assurance” marking exercise across four end-of-module assessments across a distance university CS curriculum. Each marker received five ChatGPT-generated scripts alongside 10 student scripts. A total of 90 scripts were marked; every ChatGPT-generated script for the undergraduate modules received at least a passing grade (&gt;40%), with all of the introductory module CS1 scripts receiving a distinction (&gt;85%). None of the ChatGPT taught postgraduate scripts received a passing grade (&gt;50%). We also present the results of interviewing the markers, and of running our sample scripts through a GPT-2 detector and the TurnItIn AI detector which both identified every ChatGPT-generated script, but differed in the number of false-positives. As such, we contribute a baseline understanding of how the public release of generative AI is likely to significantly impact quality assurance processes. Our analysis demonstrates that, in most cases, across a range of question formats, topics and study levels, ChatGPT is at least capable of producing adequate answers for undergraduate assessment.</p>","PeriodicalId":48764,"journal":{"name":"ACM Transactions on Computing Education","volume":"35 6","pages":""},"PeriodicalIF":2.4,"publicationDate":"2023-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138503007","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Assessing the Effect of Programming Language and Task Type On Eye Movements of Computer Science Students 程序语言和任务类型对计算机专业学生眼动的影响
3区 工程技术
ACM Transactions on Computing Education Pub Date : 2023-11-14 DOI: 10.1145/3632530
Niloofar Mansoor, Cole S. Peterson, Michael D. Dodd, Bonita Sharif
{"title":"Assessing the Effect of Programming Language and Task Type On Eye Movements of Computer Science Students","authors":"Niloofar Mansoor, Cole S. Peterson, Michael D. Dodd, Bonita Sharif","doi":"10.1145/3632530","DOIUrl":"https://doi.org/10.1145/3632530","url":null,"abstract":"Background and Context: Understanding how a student programmer solves different task types in different programming languages is essential to understanding how we can further improve teaching tools to support students to be industry-ready when they graduate. It also provides insight into students’ thought processes in different task types and languages. Few (if any) studies investigate whether any differences exist between the reading and navigation behavior while completing different types of tasks in different programming languages. Objectives: We investigate whether the use of a certain programming language (C++ vs. Python) and type of task (new feature vs. bug fixing) has an impact on performance and eye movement behavior in students exposed to both languages and task types. Participants: Fourteen students were recruited from a Python course that taught Python as an introductory programming language. Study Method: An eye tracker was used to track how student programmers navigate and view source code in different programming languages for different types of tasks. The students worked in the Geany IDE (used also in their course) while eye tracking data was collected behind the scenes making their working environment realistic compared to prior studies. Each task type had a Python and C++ version, albeit on different problems to avoid learning effects. Standard eye tracking metrics of fixation count and fixation durations were calculated on various areas of the screen and on source code lines. Normalized versions of these metrics were used to compare across languages and tasks. Findings: We found that the participants had significantly longer average fixation duration and total fixation duration adjusted for source code length during bug fixing tasks than the feature addition tasks, indicating bug fixing is harder. Furthermore, participants looked at lines adjacent to the line containing the bug more often before looking at the buggy line itself. Participants who added a new feature correctly made their first edit earlier compared to those who failed to add the feature. Tasks in Python and C++ have similar overall fixation duration and counts when adjusted for character count. The participants spent more time fixating on the console output while doing Python tasks. Overall, task type has a bigger effect on the overall fixation duration and count compared to the programming language. Conclusions: CS educators can better support students in debugging their code if they know what they typically look at while bug fixing. For new feature tasks, training students not to fear edits to learn about the code could also be actively taught and encouraged in the classroom. CS education researchers can benefit by building better IDE plugins and tools based on eye movements that guide novices in recognizing bugs and aid in adding features. These results will lead to updating prior theories on mental models in program comprehension of how developers read and un","PeriodicalId":48764,"journal":{"name":"ACM Transactions on Computing Education","volume":"10 9","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134954357","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信