垂直站点搜索系统的检索技术这些年有进步吗?真实Web系统的整体评估

Q3 Social Sciences

Journal of Information Science Theory and Practice Pub Date : 2015-12-30 DOI:10.1633/JISTAP.2015.3.4.2

Thomas Mandl, Christa Womser-Hacker, Natalia Gatzke

{"title":"垂直站点搜索系统的检索技术这些年有进步吗?真实Web系统的整体评估","authors":"Thomas Mandl, Christa Womser-Hacker, Natalia Gatzke","doi":"10.1633/JISTAP.2015.3.4.2","DOIUrl":null,"url":null,"abstract":"Evaluation of retrieval systems is mostly limited to laboratory settings and rarely considers changes of performance over time. This article presents an evaluation of retrieval systems for internal Web site search systems between the years 2006 and 2011. A holistic evaluation methodology for real Web sites was developed which includes tests for functionality, search quality, and user interaction. Among other sites, one set of 20 Web site search systems was evaluated three times in different years and no substantial improvement could be shown. It is surprising that the communication between site and user still leads to very poor results in many cases. Overall, the quality of these search systems could be improved, and several areas for improvement are apparent from our evaluation. For a comparison, Google’s site search function was also tested with the same tasks.","PeriodicalId":37582,"journal":{"name":"Journal of Information Science Theory and Practice","volume":"21 1","pages":"19-34"},"PeriodicalIF":0.0000,"publicationDate":"2015-12-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Has Retrieval Technology in Vertical Site Search Systems Improved over the Years? A Holistic Evaluation for Real Web Systems\",\"authors\":\"Thomas Mandl, Christa Womser-Hacker, Natalia Gatzke\",\"doi\":\"10.1633/JISTAP.2015.3.4.2\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Evaluation of retrieval systems is mostly limited to laboratory settings and rarely considers changes of performance over time. This article presents an evaluation of retrieval systems for internal Web site search systems between the years 2006 and 2011. A holistic evaluation methodology for real Web sites was developed which includes tests for functionality, search quality, and user interaction. Among other sites, one set of 20 Web site search systems was evaluated three times in different years and no substantial improvement could be shown. It is surprising that the communication between site and user still leads to very poor results in many cases. Overall, the quality of these search systems could be improved, and several areas for improvement are apparent from our evaluation. For a comparison, Google’s site search function was also tested with the same tasks.\",\"PeriodicalId\":37582,\"journal\":{\"name\":\"Journal of Information Science Theory and Practice\",\"volume\":\"21 1\",\"pages\":\"19-34\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2015-12-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Information Science Theory and Practice\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1633/JISTAP.2015.3.4.2\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"Social Sciences\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Information Science Theory and Practice","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1633/JISTAP.2015.3.4.2","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"Social Sciences","Score":null,"Total":0}

引用次数: 2

摘要

对检索系统的评价大多局限于实验室设置，很少考虑性能随时间的变化。本文对2006年到2011年间的内部网站搜索系统的检索系统进行了评价。为真实的Web站点开发了一种全面的评估方法，其中包括对功能、搜索质量和用户交互的测试。在其他网站中，一组20个网站搜索系统在不同的年份进行了三次评估，没有显示出实质性的改进。令人惊讶的是，在许多情况下，站点和用户之间的沟通仍然导致非常糟糕的结果。总的来说，这些搜索系统的质量可以得到改进，从我们的评估中可以明显看出有几个方面需要改进。作为对比，谷歌的网站搜索功能也用同样的任务进行了测试。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Has Retrieval Technology in Vertical Site Search Systems Improved over the Years? A Holistic Evaluation for Real Web Systems

Evaluation of retrieval systems is mostly limited to laboratory settings and rarely considers changes of performance over time. This article presents an evaluation of retrieval systems for internal Web site search systems between the years 2006 and 2011. A holistic evaluation methodology for real Web sites was developed which includes tests for functionality, search quality, and user interaction. Among other sites, one set of 20 Web site search systems was evaluated three times in different years and no substantial improvement could be shown. It is surprising that the communication between site and user still leads to very poor results in many cases. Overall, the quality of these search systems could be improved, and several areas for improvement are apparent from our evaluation. For a comparison, Google’s site search function was also tested with the same tasks.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

Journal of Information Science Theory and Practice Social Sciences-Library and Information Sciences

CiteScore

1.10

自引率

0.00%

发文量

审稿时长

12 weeks

期刊介绍： The Journal of Information Science Theory and Practice (JISTaP) is an international journal that aims at publishing original studies, review papers and brief communications on information science theory and practice. The journal provides an international forum for practical as well as theoretical research in the interdisciplinary areas of information science, such as information processing and management, knowledge organization, scholarly communication and bibliometrics. To foster scholarly communication among researchers and practitioners of library and information science around the globe, JISTaP offers a no-fee open access publishing venue where a team of dedicated editors, reviewers and staff members volunteer their services to ensure rapid dissemination and communication of scholarly works that make significant contributions. In a modern society, where information production and consumption grow at an astronomical rate, the science of information management, organization, and analysis is invaluable in effective utilization of information. The key objective of the journal is to foster research that can contribute to advancements and innovations in the theory and practice of information and library science so as to promote timely application of the findings from scientific investigations to everyday life. Recognizing the importance of the global perspective with understanding of region-specific issues, JISTaP encourages submissions of manuscripts that discuss global implications of regional findings as well as regional implications of global findings.