{"title":"A Multimetric Approach for Evaluation of ChatGPT-Generated Text Summaries","authors":"Jonas Benedikt Arnold;Dominik Hörauf","doi":"10.1109/EMR.2024.3381176","DOIUrl":"https://doi.org/10.1109/EMR.2024.3381176","url":null,"abstract":"This article investigates the summarization capabilities of ChatGPT, a language model seen as effectively shortening texts, employing a hypothesis-generating and explorative approach. Using a specific prompt, the study examines the expected lengths of generated summaries across various input word counts (IWC). A shortening ratio is introduced to describe these relationships, with identified dependencies on IWCs between 100 and 400 words. The study also explores coherence comparisons, highlighting that the ChatGPT-generated text is often evaluated as more coherent than the original. The article introduces a multimetric approach for the evaluation and discusses dependencies of best case summaries on different input word counts, providing insights into the model's performance characteristics.","PeriodicalId":35585,"journal":{"name":"IEEE Engineering Management Review","volume":"52 3","pages":"43-53"},"PeriodicalIF":0.0,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141725531","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Proceedings of the IEEE","authors":"","doi":"10.1109/EMR.2024.3429056","DOIUrl":"https://doi.org/10.1109/EMR.2024.3429056","url":null,"abstract":"","PeriodicalId":35585,"journal":{"name":"IEEE Engineering Management Review","volume":"52 3","pages":"252-252"},"PeriodicalIF":0.0,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10601570","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141725643","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Share Your Preprint Research with the World!","authors":"","doi":"10.1109/EMR.2024.3428509","DOIUrl":"https://doi.org/10.1109/EMR.2024.3428509","url":null,"abstract":"","PeriodicalId":35585,"journal":{"name":"IEEE Engineering Management Review","volume":"52 3","pages":"254-254"},"PeriodicalIF":0.0,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10601566","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141729946","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Some People Were Born to Lead","authors":"","doi":"10.1109/EMR.2024.3399105","DOIUrl":"https://doi.org/10.1109/EMR.2024.3399105","url":null,"abstract":"","PeriodicalId":35585,"journal":{"name":"IEEE Engineering Management Review","volume":"52 3","pages":"C2-C2"},"PeriodicalIF":0.0,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10601607","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141725671","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Pros and Cons of Artificial Intelligence–ChatGPT Adoption in Education Settings: A Literature Review and Future Research Agendas","authors":"Idria Maita;Saide Saide;Afifah Mesha Putri;Didi Muwardi","doi":"10.1109/EMR.2024.3394540","DOIUrl":"https://doi.org/10.1109/EMR.2024.3394540","url":null,"abstract":"The integration of artificial intelligence, particularly ChatGPT, in education presents both promising opportunities and notable challenges. Through a systematic review employing the PRISMA method, this article analyzed 45 references published of ChatGPTs impact on educational environments. While ChatGPT offers teachers a versatile learning tool, aiding in tasks, such as lesson planning and content generation, concerns regarding academic integrity and over-reliance on technology have emerged. Ethical considerations, including the potential for cheating in assignments and exams, highlight the need for clear guidelines and ethical frameworks to govern its use. Institutions or related organizations must address issues, such as plagiarism and data privacy, to ensure responsible integration of ChatGPT. Nurturing a growth mindset among educators and learners is crucial to effectively navigate ChatGPT integration. By aligning strategies to leverage ChatGPTs’ capabilities while mitigating risks, educators, institutions, and policymakers can enhance the quality of education in an evolving technological landscape. This article contributes to a deeper understanding of ChatGPTs’ implications in education, providing insights into its advantages and challenges. Informed decision making and proactive measures are essential to harness ChatGPTs potential for transformative impact while safeguarding educational integrity and ethics.","PeriodicalId":35585,"journal":{"name":"IEEE Engineering Management Review","volume":"52 3","pages":"27-42"},"PeriodicalIF":0.0,"publicationDate":"2024-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141725529","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
