AI evaluation of ChatGPT and human generated image/textual contents by bipolar generalized fuzzy hypergraph

IF 10.7 2区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Abbas Amini, Narjes Firouzkouhi, Wael Farag, Omar Ali, Isam Zabalawi, Bijan Davvaz
{"title":"AI evaluation of ChatGPT and human generated image/textual contents by bipolar generalized fuzzy hypergraph","authors":"Abbas Amini,&nbsp;Narjes Firouzkouhi,&nbsp;Wael Farag,&nbsp;Omar Ali,&nbsp;Isam Zabalawi,&nbsp;Bijan Davvaz","doi":"10.1007/s10462-024-11015-7","DOIUrl":null,"url":null,"abstract":"<div><p>Artificial Intelligence (AI) tools, i.e., ChatGPT (Chat Generative Pre-Trained Transformer), are positively and negatively revolutionizing the culture of industries, science, and education. The main objectives of this study are to address uncertainty and vagueness in ChatGPT systems, apply bipolarity as two-sided states of data, model generalized graph-based network with derivations, develop bipolar multi-dimensional fuzzy relation, advance entropy metrics for quantifying ambiguity, cluster entities based on level cuts, present pattern recognition in terms of statistical correlation coefficient, analyze speech recognition framework, and schedule online surgeries on the basis of blockchain technology. The outlined innovation pinpoints on the self-evaluation of ChatGPT systems, merging the bipolarity and generalized fuzzy hypergraph approach, developing the interpretation of graph-based patterns, and benchmarking the AI analysis and metrics advancement. To assess the efficiency of AI bipolar generalized fuzzy hypergraph (BGFH) model, the key conceptual benchmarks are clustering technique for detecting patterns and similar groups of data, statistical methods for the analysis of pattern recognition, and entropy metrics for quantifying the fuzziness within a system. This layout furnishes important characteristics such as union, intersection, complement, homomorphism, isomorphism, verifying the overlapping (intersection) and complement of two strong BGFHs as a strong BGFH. In addition, certain specifications of reflexive, symmetric, transitive, overlapping and integration, are defined using bipolar multi-dimensional fuzzy relation. Eleven classes are derived based on different values within <span>\\(t\\in [0,1]\\)</span> and <span>\\(s\\in [-1,0],\\)</span> classifying analogous data that aids the similarity detection of generated outputs. Through this approach, a new pattern recognition is used as a data evaluation technique to intelligently facilitate the process in terms of correlation coefficient. It is revealed that the highest magnitude of 0.145 is adopted for patterns <span>\\(C_{1}\\)</span> and <i>D</i>, indicating the most positive correlation between patterns, while patterns <span>\\(C_{4}\\)</span> and <i>D</i> with the value of <span>\\(-0.35\\)</span> are negatively correlated. The results verify that the entropy measure of visual data (0.75) is higher than the entropy measure of textual data with the value of 0.68, indicating more vagueness and ambiguity in visual generated systems. The corresponding textual data <span>\\(E^{P}(U)\\)</span> and <span>\\(E^{N}(U)\\)</span> are, respectively, calculated as 0.62 and 0.45 for human-created contents and ChatGPT-generated contents, whilst for visual data, the entropy measures <span>\\(E^{P}(U)\\)</span> and <span>\\(E^{N}(U)\\)</span> are, respectively, 0.25 and 0.66, showing the higher values for the entropy measure of ChatGPT-generated visual data compared to the ChatGPT-generated textual data. In relation to the speech recognition analysis, the highest human performance degree is affiliated to word “a” (0.89), while the lowest degree belongs to word “i” (0.81). The highest AI performance degree is allocated to word “it” <span>\\((-0.7),\\)</span> and the lowest degree is affiliated to word “the” <span>\\((-0.88).\\)</span> The overall entropy measure is calculated by 0.23, and the entropy measure of AI-based data is 0.35, on the other hand, the entropy measure of human-based data is equal to 0.29, representing higher vagueness for AI-based data. According to the obtained results in surgical case scheduling, the bipolar value of <span>\\((0.9,-0.1)\\)</span> is allocated to the surgeon who has the highest positive performance (0.9) and the lowest negative performance <span>\\((-0.1);\\)</span> this indicates the superior overall performance <span>\\((\\lambda _{a}=0.8)\\)</span> of the leader during the AI blockchain robotic colon surgery. The worst overall performance (0.22) is allotted to the surgeon, who is required to be removed from the surgery team by the leader physician. The outcomes are validated by a comparative analysis with respect to the classical bipolar fuzzy graph and bipolar fuzzy hypergraph, and NLP (natural language processing) approaches.</p></div>","PeriodicalId":8449,"journal":{"name":"Artificial Intelligence Review","volume":"58 3","pages":""},"PeriodicalIF":10.7000,"publicationDate":"2025-01-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://link.springer.com/content/pdf/10.1007/s10462-024-11015-7.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Artificial Intelligence Review","FirstCategoryId":"94","ListUrlMain":"https://link.springer.com/article/10.1007/s10462-024-11015-7","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Artificial Intelligence (AI) tools, i.e., ChatGPT (Chat Generative Pre-Trained Transformer), are positively and negatively revolutionizing the culture of industries, science, and education. The main objectives of this study are to address uncertainty and vagueness in ChatGPT systems, apply bipolarity as two-sided states of data, model generalized graph-based network with derivations, develop bipolar multi-dimensional fuzzy relation, advance entropy metrics for quantifying ambiguity, cluster entities based on level cuts, present pattern recognition in terms of statistical correlation coefficient, analyze speech recognition framework, and schedule online surgeries on the basis of blockchain technology. The outlined innovation pinpoints on the self-evaluation of ChatGPT systems, merging the bipolarity and generalized fuzzy hypergraph approach, developing the interpretation of graph-based patterns, and benchmarking the AI analysis and metrics advancement. To assess the efficiency of AI bipolar generalized fuzzy hypergraph (BGFH) model, the key conceptual benchmarks are clustering technique for detecting patterns and similar groups of data, statistical methods for the analysis of pattern recognition, and entropy metrics for quantifying the fuzziness within a system. This layout furnishes important characteristics such as union, intersection, complement, homomorphism, isomorphism, verifying the overlapping (intersection) and complement of two strong BGFHs as a strong BGFH. In addition, certain specifications of reflexive, symmetric, transitive, overlapping and integration, are defined using bipolar multi-dimensional fuzzy relation. Eleven classes are derived based on different values within \(t\in [0,1]\) and \(s\in [-1,0],\) classifying analogous data that aids the similarity detection of generated outputs. Through this approach, a new pattern recognition is used as a data evaluation technique to intelligently facilitate the process in terms of correlation coefficient. It is revealed that the highest magnitude of 0.145 is adopted for patterns \(C_{1}\) and D, indicating the most positive correlation between patterns, while patterns \(C_{4}\) and D with the value of \(-0.35\) are negatively correlated. The results verify that the entropy measure of visual data (0.75) is higher than the entropy measure of textual data with the value of 0.68, indicating more vagueness and ambiguity in visual generated systems. The corresponding textual data \(E^{P}(U)\) and \(E^{N}(U)\) are, respectively, calculated as 0.62 and 0.45 for human-created contents and ChatGPT-generated contents, whilst for visual data, the entropy measures \(E^{P}(U)\) and \(E^{N}(U)\) are, respectively, 0.25 and 0.66, showing the higher values for the entropy measure of ChatGPT-generated visual data compared to the ChatGPT-generated textual data. In relation to the speech recognition analysis, the highest human performance degree is affiliated to word “a” (0.89), while the lowest degree belongs to word “i” (0.81). The highest AI performance degree is allocated to word “it” \((-0.7),\) and the lowest degree is affiliated to word “the” \((-0.88).\) The overall entropy measure is calculated by 0.23, and the entropy measure of AI-based data is 0.35, on the other hand, the entropy measure of human-based data is equal to 0.29, representing higher vagueness for AI-based data. According to the obtained results in surgical case scheduling, the bipolar value of \((0.9,-0.1)\) is allocated to the surgeon who has the highest positive performance (0.9) and the lowest negative performance \((-0.1);\) this indicates the superior overall performance \((\lambda _{a}=0.8)\) of the leader during the AI blockchain robotic colon surgery. The worst overall performance (0.22) is allotted to the surgeon, who is required to be removed from the surgery team by the leader physician. The outcomes are validated by a comparative analysis with respect to the classical bipolar fuzzy graph and bipolar fuzzy hypergraph, and NLP (natural language processing) approaches.

求助全文
约1分钟内获得全文 求助全文
来源期刊
Artificial Intelligence Review
Artificial Intelligence Review 工程技术-计算机:人工智能
CiteScore
22.00
自引率
3.30%
发文量
194
审稿时长
5.3 months
期刊介绍: Artificial Intelligence Review, a fully open access journal, publishes cutting-edge research in artificial intelligence and cognitive science. It features critical evaluations of applications, techniques, and algorithms, providing a platform for both researchers and application developers. The journal includes refereed survey and tutorial articles, along with reviews and commentary on significant developments in the field.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信