Emily F. Ruff*, Jeanne L. Franz and Joseph K. West,
{"title":"在高年级实验课程中使用 ChatGPT 进行方法开发和绿色化学教育","authors":"Emily F. Ruff*, Jeanne L. Franz and Joseph K. West, ","doi":"10.1021/acs.jchemed.4c0019310.1021/acs.jchemed.4c00193","DOIUrl":null,"url":null,"abstract":"<p >Large language models (LLMs) such as ChatGPT are being used for outlining, writing assistance, and higher-level research tasks in many areas of science. The purpose of the work described here was to assess ChatGPT version 3.5’s ability to help upper-level Analytical and Inorganic Chemistry students find methods and green modifications to use in laboratory proposals. Some students found that ChatGPT provided a helpful starting point, but it mostly gave vague and erroneous responses when asked to provide upper-level methods in these areas, particularly in green chemistry. Few ChatGPT suggestions were useful for students’ proposals. Students usually used reasonable prompts, and they often evaluated ChatGPT outputs correctly; however, most students reported they were not confident using its responses. Some lacked confidence in ChatGPT outputs because it rarely provided references, and some said they preferred formal literature searching. Despite ChatGPT’s deficiencies in producing usable methods, we found evidence that these were valuable exercises for helping students think critically about procedures and artificial intelligence (AI) outputs. An accompanying anonymous survey suggested that student opinions of ChatGPT and AI technologies varied depending on what they had used them for. Based on this work, we offer suggestions for other instructors who wish to design similar method development assignments that incorporate LLMs.</p>","PeriodicalId":43,"journal":{"name":"Journal of Chemical Education","volume":"101 8","pages":"3224–3232 3224–3232"},"PeriodicalIF":2.9000,"publicationDate":"2024-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://pubs.acs.org/doi/epdf/10.1021/acs.jchemed.4c00193","citationCount":"0","resultStr":"{\"title\":\"Using ChatGPT for Method Development and Green Chemistry Education in Upper-Level Laboratory Courses\",\"authors\":\"Emily F. Ruff*, Jeanne L. Franz and Joseph K. West, \",\"doi\":\"10.1021/acs.jchemed.4c0019310.1021/acs.jchemed.4c00193\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p >Large language models (LLMs) such as ChatGPT are being used for outlining, writing assistance, and higher-level research tasks in many areas of science. The purpose of the work described here was to assess ChatGPT version 3.5’s ability to help upper-level Analytical and Inorganic Chemistry students find methods and green modifications to use in laboratory proposals. Some students found that ChatGPT provided a helpful starting point, but it mostly gave vague and erroneous responses when asked to provide upper-level methods in these areas, particularly in green chemistry. Few ChatGPT suggestions were useful for students’ proposals. Students usually used reasonable prompts, and they often evaluated ChatGPT outputs correctly; however, most students reported they were not confident using its responses. Some lacked confidence in ChatGPT outputs because it rarely provided references, and some said they preferred formal literature searching. Despite ChatGPT’s deficiencies in producing usable methods, we found evidence that these were valuable exercises for helping students think critically about procedures and artificial intelligence (AI) outputs. An accompanying anonymous survey suggested that student opinions of ChatGPT and AI technologies varied depending on what they had used them for. Based on this work, we offer suggestions for other instructors who wish to design similar method development assignments that incorporate LLMs.</p>\",\"PeriodicalId\":43,\"journal\":{\"name\":\"Journal of Chemical Education\",\"volume\":\"101 8\",\"pages\":\"3224–3232 3224–3232\"},\"PeriodicalIF\":2.9000,\"publicationDate\":\"2024-07-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://pubs.acs.org/doi/epdf/10.1021/acs.jchemed.4c00193\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Chemical Education\",\"FirstCategoryId\":\"92\",\"ListUrlMain\":\"https://pubs.acs.org/doi/10.1021/acs.jchemed.4c00193\",\"RegionNum\":3,\"RegionCategory\":\"教育学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"CHEMISTRY, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Chemical Education","FirstCategoryId":"92","ListUrlMain":"https://pubs.acs.org/doi/10.1021/acs.jchemed.4c00193","RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}
Using ChatGPT for Method Development and Green Chemistry Education in Upper-Level Laboratory Courses
Large language models (LLMs) such as ChatGPT are being used for outlining, writing assistance, and higher-level research tasks in many areas of science. The purpose of the work described here was to assess ChatGPT version 3.5’s ability to help upper-level Analytical and Inorganic Chemistry students find methods and green modifications to use in laboratory proposals. Some students found that ChatGPT provided a helpful starting point, but it mostly gave vague and erroneous responses when asked to provide upper-level methods in these areas, particularly in green chemistry. Few ChatGPT suggestions were useful for students’ proposals. Students usually used reasonable prompts, and they often evaluated ChatGPT outputs correctly; however, most students reported they were not confident using its responses. Some lacked confidence in ChatGPT outputs because it rarely provided references, and some said they preferred formal literature searching. Despite ChatGPT’s deficiencies in producing usable methods, we found evidence that these were valuable exercises for helping students think critically about procedures and artificial intelligence (AI) outputs. An accompanying anonymous survey suggested that student opinions of ChatGPT and AI technologies varied depending on what they had used them for. Based on this work, we offer suggestions for other instructors who wish to design similar method development assignments that incorporate LLMs.
期刊介绍:
The Journal of Chemical Education is the official journal of the Division of Chemical Education of the American Chemical Society, co-published with the American Chemical Society Publications Division. Launched in 1924, the Journal of Chemical Education is the world’s premier chemical education journal. The Journal publishes peer-reviewed articles and related information as a resource to those in the field of chemical education and to those institutions that serve them. JCE typically addresses chemical content, activities, laboratory experiments, instructional methods, and pedagogies. The Journal serves as a means of communication among people across the world who are interested in the teaching and learning of chemistry. This includes instructors of chemistry from middle school through graduate school, professional staff who support these teaching activities, as well as some scientists in commerce, industry, and government.