Xiaozhe Yang (杨晓哲), Qingqing Wang (王晴晴), Jiyue Lyu (吕霁月)
{"title":"Assessing ChatGPT’s Educational Capabilities and Application Potential","authors":"Xiaozhe Yang (杨晓哲), Qingqing Wang (王晴晴), Jiyue Lyu (吕霁月)","doi":"10.1177/20965311231210006","DOIUrl":null,"url":null,"abstract":"Purpose ChatGPT is a generative artificial intelligence (AI) technology that can solve multiple complex tasks. ChatGPT-4 can facilitate educational empowerment in China through technology to understand and generate Chinese text. Although ChatGPT's benefits have been widely discussed, its educational capabilities have not been systematically assessed. This study provides evidence of and insights into the educational applications of AI tools in China. Design/Approach/Methods This study uses various tests to systematically assess the latest iteration of the AI chatbot ChatGPT-4, including the Watson-Glaser Critical Thinking Appraisal (WGCTA), Five Core Competencies Questionnaire, and written test of China's 2022 National Teacher Certificate Examination (NTCE). Findings The WGCTA results suggest that ChatGPT requires strong critical thinking. Compared with the other four competencies, the tool showed a lower aptitude for creativity. Regarding its educational applications, ChatGPT performed well on the 2022 NTCE written test. As technology enhances, ChatGPT and similar AI tools have potential applications in China for lesson planning, student self-learning, classroom interaction, and checking assignments. Originality/Value This study systematically tested ChatGPT at a logical level and assessed its core competencies and educational applications. The study innovatively used 2022 NTCE data to test ChatGPT, with results providing support for the application of generative AI in future curricula and instruction in China.","PeriodicalId":33103,"journal":{"name":"ECNU Review of Education","volume":"88 2","pages":"0"},"PeriodicalIF":2.7000,"publicationDate":"2023-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ECNU Review of Education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/20965311231210006","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose ChatGPT is a generative artificial intelligence (AI) technology that can solve multiple complex tasks. ChatGPT-4 can facilitate educational empowerment in China through technology to understand and generate Chinese text. Although ChatGPT's benefits have been widely discussed, its educational capabilities have not been systematically assessed. This study provides evidence of and insights into the educational applications of AI tools in China. Design/Approach/Methods This study uses various tests to systematically assess the latest iteration of the AI chatbot ChatGPT-4, including the Watson-Glaser Critical Thinking Appraisal (WGCTA), Five Core Competencies Questionnaire, and written test of China's 2022 National Teacher Certificate Examination (NTCE). Findings The WGCTA results suggest that ChatGPT requires strong critical thinking. Compared with the other four competencies, the tool showed a lower aptitude for creativity. Regarding its educational applications, ChatGPT performed well on the 2022 NTCE written test. As technology enhances, ChatGPT and similar AI tools have potential applications in China for lesson planning, student self-learning, classroom interaction, and checking assignments. Originality/Value This study systematically tested ChatGPT at a logical level and assessed its core competencies and educational applications. The study innovatively used 2022 NTCE data to test ChatGPT, with results providing support for the application of generative AI in future curricula and instruction in China.