Babu Reddy, B. Indurkhya, Sonal Aggarwal, H. Oostendorp
{"title":"Providing Web Credibility Assessment Support","authors":"Babu Reddy, B. Indurkhya, Sonal Aggarwal, H. Oostendorp","doi":"10.1145/2637248.2637260","DOIUrl":null,"url":null,"abstract":"Presence of information from multiple sources on the internet requires evaluating the credibility of the information, before its utilization. Researchers have suggested that internet users experience difficulty in accessing necessary information and do not pay enough attention to its credibility. We present here the design and implementation of an automated Web Credibility Assessment Support Tool (WebCAST) that considers multiple factors (type of website, popularity, sentiment, date of last update, reputation and review based on users' ratings reflecting personal experience) for assessing the credibility of information and returns a summary indication of the credibility of a website. We use Potentially All Pairwise RanKings of all possible Alternatives (PAPRIKA) method of Multi-Criteria Decision Analysis (MCDA) to give weights to the scale values on each factor, representing the relative importance of the attributes. An empirical evaluation of the tool was conducted by computing the correlation between the tool-generated credibility scores and that of human judges. The correlation was found to be 0.89, thus verifying the validity of the tool. In the future the proposed tool can be made useful to students in their learning process of credibility assessment.","PeriodicalId":93284,"journal":{"name":"ECCE ... : proceedings of the ... European Conference on Cognitive Ergonomics. European Conference on Cognitive Ergonomics","volume":"81 1","pages":"29: 1-29: 8"},"PeriodicalIF":0.0000,"publicationDate":"2014-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"18","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ECCE ... : proceedings of the ... European Conference on Cognitive Ergonomics. European Conference on Cognitive Ergonomics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/2637248.2637260","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 18
Abstract
Presence of information from multiple sources on the internet requires evaluating the credibility of the information, before its utilization. Researchers have suggested that internet users experience difficulty in accessing necessary information and do not pay enough attention to its credibility. We present here the design and implementation of an automated Web Credibility Assessment Support Tool (WebCAST) that considers multiple factors (type of website, popularity, sentiment, date of last update, reputation and review based on users' ratings reflecting personal experience) for assessing the credibility of information and returns a summary indication of the credibility of a website. We use Potentially All Pairwise RanKings of all possible Alternatives (PAPRIKA) method of Multi-Criteria Decision Analysis (MCDA) to give weights to the scale values on each factor, representing the relative importance of the attributes. An empirical evaluation of the tool was conducted by computing the correlation between the tool-generated credibility scores and that of human judges. The correlation was found to be 0.89, thus verifying the validity of the tool. In the future the proposed tool can be made useful to students in their learning process of credibility assessment.
在互联网上存在来自多个来源的信息,需要在使用信息之前评估信息的可信度。研究人员指出,互联网用户在获取必要信息方面遇到困难,而且对信息的可信度不够重视。我们在这里展示了一个自动网络可信度评估支持工具(WebCAST)的设计和实现,该工具考虑了多种因素(网站类型、受欢迎程度、情绪、最后更新日期、声誉和基于反映个人经验的用户评级的评论)来评估信息的可信度,并返回网站可信度的摘要指示。我们使用多标准决策分析(MCDA)的PAPRIKA (potential All Pairwise RanKings of All possible Alternatives)方法为每个因素的尺度值赋予权重,表示属性的相对重要性。通过计算工具生成的可信度评分与人类法官的可信度评分之间的相关性,对该工具进行了实证评估。相关性发现为0.89,从而验证了工具的有效性。在未来,该工具可以在学生学习可信度评估的过程中发挥作用。