Exploring natural language processing in mechanical engineering education: Implications for academic integrity

IF 1.1 Q3 EDUCATION, SCIENTIFIC DISCIPLINES

International Journal of Mechanical Engineering Education Pub Date : 2023-03-27 DOI:10.1177/03064190231166665

Jonathan Lesage, R. Brennan, Sarah Elaine Eaton, B. Moya, B. McDermott, J. Wiens, Kai Herrero

{"title":"Exploring natural language processing in mechanical engineering education: Implications for academic integrity","authors":"Jonathan Lesage, R. Brennan, Sarah Elaine Eaton, B. Moya, B. McDermott, J. Wiens, Kai Herrero","doi":"10.1177/03064190231166665","DOIUrl":null,"url":null,"abstract":"In this paper, the authors review extant natural language processing models in the context of undergraduate mechanical engineering education. These models have advanced to a stage where it has become increasingly more difficult to discern computer vs. human-produced material, and as a result, have understandably raised questions about their impact on academic integrity. As part of our review, we perform two sets of tests with OpenAI's natural language processing model (1) using GPT-3 to generate text for a mechanical engineering laboratory report and (2) using Codex to generate code for an automation and control systems laboratory. Our results show that natural language processing is a potentially powerful assistive technology for engineering students. However, it is a technology that must be used with care, given its potential to enable cheating and plagiarism behaviours given how the technology challenges traditional assessment practices and traditional notions of authorship.","PeriodicalId":39952,"journal":{"name":"International Journal of Mechanical Engineering Education","volume":null,"pages":null},"PeriodicalIF":1.1000,"publicationDate":"2023-03-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Mechanical Engineering Education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/03064190231166665","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}

引用次数: 3

Abstract

In this paper, the authors review extant natural language processing models in the context of undergraduate mechanical engineering education. These models have advanced to a stage where it has become increasingly more difficult to discern computer vs. human-produced material, and as a result, have understandably raised questions about their impact on academic integrity. As part of our review, we perform two sets of tests with OpenAI's natural language processing model (1) using GPT-3 to generate text for a mechanical engineering laboratory report and (2) using Codex to generate code for an automation and control systems laboratory. Our results show that natural language processing is a potentially powerful assistive technology for engineering students. However, it is a technology that must be used with care, given its potential to enable cheating and plagiarism behaviours given how the technology challenges traditional assessment practices and traditional notions of authorship.

查看原文本刊更多论文

探索机械工程教育中的自然语言处理：对学术诚信的启示

在这篇论文中，作者回顾了现存的自然语言处理模型在本科生机械工程教育的背景下。这些模型已经发展到一个阶段，在这个阶段，辨别计算机制作的材料与人类制作的材料变得越来越困难，因此，可以理解的是，这些模型对学术诚信的影响提出了质疑。作为我们审查的一部分，我们使用OpenAI的自然语言处理模型进行了两组测试：（1）使用GPT-3为机械工程实验室报告生成文本；（2）使用Codex为自动化和控制系统实验室生成代码。我们的研究结果表明，对于工科学生来说，自然语言处理是一种潜在的强大辅助技术。然而，鉴于这项技术对传统评估实践和传统作者观念的挑战，它有可能导致作弊和剽窃行为，因此必须谨慎使用这项技术。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

International Journal of Mechanical Engineering Education Social Sciences-Education

CiteScore

3.00

自引率

28.60%

发文量

期刊介绍： The International Journal of Mechanical Engineering Education is aimed at teachers and trainers of mechanical engineering students in higher education and focuses on the discussion of the principles and practices of training professional, technical and mechanical engineers and those in related fields. It encourages articles about new experimental methods, and laboratory techniques, and includes book reviews and highlights of recent articles in this field.