公共政策教学与评估中的 ChatGPT:对机遇和挑战的审视

IF 2.1 4区 管理学 Q2 PUBLIC ADMINISTRATION
Daniel Casey
{"title":"公共政策教学与评估中的 ChatGPT:对机遇和挑战的审视","authors":"Daniel Casey","doi":"10.1111/1467-8500.12647","DOIUrl":null,"url":null,"abstract":"This paper presents the findings of an innovative assessment task that required students to use ChatGPT for drafting a policy brief to an Australian Government minister. The study explores how future public policy students perceive ChatGPT's role in both public policy and teaching and assessment. Through self‐reflective essays and focus group discussions, the research looks at the limitations of ChatGPT that the students identified, demonstrating it struggles to produce analytically sound, politically responsive, and nuanced policy recommendations. The findings align with the “technoscepticism” theoretical frame, indicating concerns that artificial intelligence (AI) tools could undermine good policy analysis processes. The students supported greater use of ChatGPT in the classroom, to increase ChatGPT‐literacy, help students learn to engage ethically and appropriately with AI tools, and better develop evaluative judgement skills.The paper contributes insights into the intersection of ChatGPT, teaching and assessment, and public policy and seeks to prompt further exploration and discussion on the implications of integrating ChatGPT into both public policy and its education and assessment.\nFuture public service graduates are highly sceptical about the value of ChatGPT for developing policy.\nThey are concerned about the ethical implications, the lack of transparency, and the impact it may have on marginalised communities.\n","PeriodicalId":47373,"journal":{"name":"Australian Journal of Public Administration","volume":null,"pages":null},"PeriodicalIF":2.1000,"publicationDate":"2024-05-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"ChatGPT in public policy teaching and assessment: An examination of opportunities and challenges\",\"authors\":\"Daniel Casey\",\"doi\":\"10.1111/1467-8500.12647\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This paper presents the findings of an innovative assessment task that required students to use ChatGPT for drafting a policy brief to an Australian Government minister. The study explores how future public policy students perceive ChatGPT's role in both public policy and teaching and assessment. Through self‐reflective essays and focus group discussions, the research looks at the limitations of ChatGPT that the students identified, demonstrating it struggles to produce analytically sound, politically responsive, and nuanced policy recommendations. The findings align with the “technoscepticism” theoretical frame, indicating concerns that artificial intelligence (AI) tools could undermine good policy analysis processes. The students supported greater use of ChatGPT in the classroom, to increase ChatGPT‐literacy, help students learn to engage ethically and appropriately with AI tools, and better develop evaluative judgement skills.The paper contributes insights into the intersection of ChatGPT, teaching and assessment, and public policy and seeks to prompt further exploration and discussion on the implications of integrating ChatGPT into both public policy and its education and assessment.\\nFuture public service graduates are highly sceptical about the value of ChatGPT for developing policy.\\nThey are concerned about the ethical implications, the lack of transparency, and the impact it may have on marginalised communities.\\n\",\"PeriodicalId\":47373,\"journal\":{\"name\":\"Australian Journal of Public Administration\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2024-05-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Australian Journal of Public Administration\",\"FirstCategoryId\":\"91\",\"ListUrlMain\":\"https://doi.org/10.1111/1467-8500.12647\",\"RegionNum\":4,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"PUBLIC ADMINISTRATION\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Australian Journal of Public Administration","FirstCategoryId":"91","ListUrlMain":"https://doi.org/10.1111/1467-8500.12647","RegionNum":4,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PUBLIC ADMINISTRATION","Score":null,"Total":0}
引用次数: 0

摘要

本文介绍了一项创新评估任务的研究结果,该任务要求学生使用 ChatGPT 起草一份政策简报,提交给澳大利亚政府部长。该研究探讨了未来的公共政策专业学生如何看待 ChatGPT 在公共政策、教学和评估中的作用。通过自我反思文章和焦点小组讨论,研究探讨了学生们所发现的 ChatGPT 的局限性,表明它很难产生分析合理、政治反应迅速和细致入微的政策建议。研究结果与 "技术怀疑论 "的理论框架一致,表明人们担心人工智能(AI)工具会破坏良好的政策分析过程。学生们支持在课堂上更多地使用 ChatGPT,以提高 ChatGPT 的素养,帮助学生学会以道德和适当的方式使用人工智能工具,并更好地发展评估判断技能。本文对 ChatGPT、教学和评估以及公共政策的交叉点提出了见解,并试图促使人们进一步探索和讨论将 ChatGPT 纳入公共政策及其教育和评估的意义。未来的公共服务毕业生对 ChatGPT 在制定政策方面的价值持高度怀疑态度,他们担心 ChatGPT 的道德影响、缺乏透明度以及可能对边缘化群体产生的影响。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
ChatGPT in public policy teaching and assessment: An examination of opportunities and challenges
This paper presents the findings of an innovative assessment task that required students to use ChatGPT for drafting a policy brief to an Australian Government minister. The study explores how future public policy students perceive ChatGPT's role in both public policy and teaching and assessment. Through self‐reflective essays and focus group discussions, the research looks at the limitations of ChatGPT that the students identified, demonstrating it struggles to produce analytically sound, politically responsive, and nuanced policy recommendations. The findings align with the “technoscepticism” theoretical frame, indicating concerns that artificial intelligence (AI) tools could undermine good policy analysis processes. The students supported greater use of ChatGPT in the classroom, to increase ChatGPT‐literacy, help students learn to engage ethically and appropriately with AI tools, and better develop evaluative judgement skills.The paper contributes insights into the intersection of ChatGPT, teaching and assessment, and public policy and seeks to prompt further exploration and discussion on the implications of integrating ChatGPT into both public policy and its education and assessment. Future public service graduates are highly sceptical about the value of ChatGPT for developing policy. They are concerned about the ethical implications, the lack of transparency, and the impact it may have on marginalised communities.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
4.40
自引率
9.10%
发文量
26
期刊介绍: Aimed at a diverse readership, the Australian Journal of Public Administration is committed to the study and practice of public administration, public management and policy making. It encourages research, reflection and commentary amongst those interested in a range of public sector settings - federal, state, local and inter-governmental. The journal focuses on Australian concerns, but welcomes manuscripts relating to international developments of relevance to Australian experience.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信