{"title":"给聪明的人一句话:为ChatGPT制作有影响力的提示","authors":"Myunghwan Hwang , Ki-Ho Lee , Hee-Kyung Lee","doi":"10.1016/j.system.2025.103756","DOIUrl":null,"url":null,"abstract":"<div><div>The integration of ChatGPT into higher education has grown rapidly, yet research on students’ prompting behaviors remains limited. This study examines learner-generated prompts, focusing on linguistic features, prompt engineering strategies, and content-related problems, as well as their impact on response quality, measured by learner satisfaction. A total of 238 prompts from ten Korean EFL graduate students in English education were collected through reflection logs and analyzed using one-way ANOVA, correlation analysis, network analysis, and K-means clustering. Results indicate that learners predominantly used concise prompts with minimal strategy, with English prompts yielding higher satisfaction than those in their first language. High-satisfaction prompts incorporated clear, interconnected strategies, while low-satisfaction prompts featured fragmented ones. Key strategies associated with high satisfaction included contextualization and specifying text style, tone, and length, while repetition correlated with dissatisfaction. Furthermore, a thematic analysis identified six main problems that hindered response quality: lack of context, unclear feedback, dual requests, grammatical errors, abstract vocabulary, and excessive constraints. These findings highlight the significance of clear, contextually rich, and strategically crafted prompts in optimizing interactions with ChatGPT, along with the need to equip EFL learners with distinct prompting techniques tailored for AI-assisted language learning, separate from traditional human communication.</div></div>","PeriodicalId":48185,"journal":{"name":"System","volume":"133 ","pages":"Article 103756"},"PeriodicalIF":5.6000,"publicationDate":"2025-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A word to the wise: Crafting impactful prompts for ChatGPT\",\"authors\":\"Myunghwan Hwang , Ki-Ho Lee , Hee-Kyung Lee\",\"doi\":\"10.1016/j.system.2025.103756\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The integration of ChatGPT into higher education has grown rapidly, yet research on students’ prompting behaviors remains limited. This study examines learner-generated prompts, focusing on linguistic features, prompt engineering strategies, and content-related problems, as well as their impact on response quality, measured by learner satisfaction. A total of 238 prompts from ten Korean EFL graduate students in English education were collected through reflection logs and analyzed using one-way ANOVA, correlation analysis, network analysis, and K-means clustering. Results indicate that learners predominantly used concise prompts with minimal strategy, with English prompts yielding higher satisfaction than those in their first language. High-satisfaction prompts incorporated clear, interconnected strategies, while low-satisfaction prompts featured fragmented ones. Key strategies associated with high satisfaction included contextualization and specifying text style, tone, and length, while repetition correlated with dissatisfaction. Furthermore, a thematic analysis identified six main problems that hindered response quality: lack of context, unclear feedback, dual requests, grammatical errors, abstract vocabulary, and excessive constraints. These findings highlight the significance of clear, contextually rich, and strategically crafted prompts in optimizing interactions with ChatGPT, along with the need to equip EFL learners with distinct prompting techniques tailored for AI-assisted language learning, separate from traditional human communication.</div></div>\",\"PeriodicalId\":48185,\"journal\":{\"name\":\"System\",\"volume\":\"133 \",\"pages\":\"Article 103756\"},\"PeriodicalIF\":5.6000,\"publicationDate\":\"2025-06-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"System\",\"FirstCategoryId\":\"98\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0346251X25001666\",\"RegionNum\":1,\"RegionCategory\":\"文学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"System","FirstCategoryId":"98","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0346251X25001666","RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
A word to the wise: Crafting impactful prompts for ChatGPT
The integration of ChatGPT into higher education has grown rapidly, yet research on students’ prompting behaviors remains limited. This study examines learner-generated prompts, focusing on linguistic features, prompt engineering strategies, and content-related problems, as well as their impact on response quality, measured by learner satisfaction. A total of 238 prompts from ten Korean EFL graduate students in English education were collected through reflection logs and analyzed using one-way ANOVA, correlation analysis, network analysis, and K-means clustering. Results indicate that learners predominantly used concise prompts with minimal strategy, with English prompts yielding higher satisfaction than those in their first language. High-satisfaction prompts incorporated clear, interconnected strategies, while low-satisfaction prompts featured fragmented ones. Key strategies associated with high satisfaction included contextualization and specifying text style, tone, and length, while repetition correlated with dissatisfaction. Furthermore, a thematic analysis identified six main problems that hindered response quality: lack of context, unclear feedback, dual requests, grammatical errors, abstract vocabulary, and excessive constraints. These findings highlight the significance of clear, contextually rich, and strategically crafted prompts in optimizing interactions with ChatGPT, along with the need to equip EFL learners with distinct prompting techniques tailored for AI-assisted language learning, separate from traditional human communication.
期刊介绍:
This international journal is devoted to the applications of educational technology and applied linguistics to problems of foreign language teaching and learning. Attention is paid to all languages and to problems associated with the study and teaching of English as a second or foreign language. The journal serves as a vehicle of expression for colleagues in developing countries. System prefers its contributors to provide articles which have a sound theoretical base with a visible practical application which can be generalized. The review section may take up works of a more theoretical nature to broaden the background.