Proceedings of the 5th Information Interaction in Context Symposium最新文献

{"title":"Simulated work tasks: the case of professional users","authors":"Tanja Svarre Jonasen, Marianne Lykke","doi":"10.1145/2637002.2637027","DOIUrl":"https://doi.org/10.1145/2637002.2637027","url":null,"abstract":"This paper investigates simulated work tasks as a tool for information retrieval (IR) evaluation in a work-based, specialized setting. It has been shown that simulated work tasks must be tailored toward the group of study participant to ensure that the depicted situations are realistic and interesting from the participants' point of view [3]. Specifically, we investigate what characterizes an effective simulated work task in a professional government setting and how to design workable tasks for the evaluation of in-house information systems such as a corporate Intranet. The findings reveal that the test participants adopt the tasks. To understand and apply the simulated work tasks, the participants draw on different types of experience and knowledge: Topical, related, structural, and common knowledge. The study also shows that the knowledge types identified are more important for successful retrieval of information than similarity of the simulated work tasks with the participants' daily work tasks.","PeriodicalId":447867,"journal":{"name":"Proceedings of the 5th Information Interaction in Context Symposium","volume":"142 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115626315","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Social priors to estimate relevance of a resource","authors":"Ismail Badache, M. Boughanem","doi":"10.1145/2637002.2637016","DOIUrl":"https://doi.org/10.1145/2637002.2637016","url":null,"abstract":"In this paper we propose an approach that exploits social data associated with a Web resource to measure its a priori relevance. We show how these interaction traces left by the users on the resources, which are in the form of social signals as the number of like and share, can be exploited to quantify social properties such as popularity and reputation. We propose to model these properties as a priori probability that we integrate into language model. We evaluated the effectiveness of our approach on IMDb dataset containing 167438 resources and their social signals collected from several social networks. Our experimental results are statistically significant and show the interest of integrating social properties in a search model to enhance the information retrieval.","PeriodicalId":447867,"journal":{"name":"Proceedings of the 5th Information Interaction in Context Symposium","volume":"18 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127071820","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Workshop on searching for fun 2014","authors":"Morgan Harvey, Max L. Wilson, K. Church","doi":"10.1145/2637002.2643202","DOIUrl":"https://doi.org/10.1145/2637002.2643202","url":null,"abstract":"The Searching for Fun workshop brings together researchers who are interested in furthering our knowledge about searching and browsing in a casual leisure scenario. These are scenarios where the searcher does not have a specific information need to fulfil, but rather simply wishes to be entertained with no specific goal in mind. This can include: online window shopping with nothing to buy, reading online (including the news), watching funny videos, finding funny pictures, browsing Wikipedia or social networking sites. Following on from the successful workshop at ECIR in 2012 and later discussions at Dagstuhl meetings, this event involves researchers from several IR sub-communities (e.g. recommender systems, result diversity, multimedia retrieval) and related disciplines, discussing new and early research and creating a vision for future work in this area.","PeriodicalId":447867,"journal":{"name":"Proceedings of the 5th Information Interaction in Context Symposium","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126611786","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Investigating the potential impact of non-personalized recommendations in the OPAC: Amazon vs. WorldCat.org","authors":"S. Wakeling, Paul D. Clough, B. Sen","doi":"10.1145/2637002.2637015","DOIUrl":"https://doi.org/10.1145/2637002.2637015","url":null,"abstract":"Recent research into the functionality of Online Public Access Catalogues (OPACs) has led to a call for such systems to incorporate functionality to facilitate resource discovery, and replicate the information search experience users encounter elsewhere on the Web. Recommendations represent one such feature. Developments so far in this area indicate that non-personalized or item-level recommendations are most suited to the OPAC environment. Whilst a number of such systems have been developed and implemented, research has yet to investigate fully the impact of such recommendations on user performance, search behavior, and system perceptions. This paper presents the results of an exploratory laboratory-based study comparing user behavior in Amazon, which offers non-personalized recommendations, and WorldCat.org, which does not. An analysis of task performance and participant interactions with the systems reveals that the presence of non-personalized recommendations improves resource discovery, search efficiency, and perceived usability.","PeriodicalId":447867,"journal":{"name":"Proceedings of the 5th Information Interaction in Context Symposium","volume":"15 1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123598434","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Combining document retrieval with knowledge graphs for exploratory search","authors":"Bahareh Sarrafzadeh, Olga Vechtomova","doi":"10.1145/2637002.2637060","DOIUrl":"https://doi.org/10.1145/2637002.2637060","url":null,"abstract":"With the massive increase in information availability, it gets more and more difficult to make sense of the available information. The Web has provided the opportunity to browse and navigate through the extensive information space by utilizing the modern search engines. This in turn has led to increasing expectations to use the Web as a source for learning and exploratory discovery. Although current Information Retrieval (IR) methods satisfy simple and straight-forward needs, they do not offer enough support for the users with complex search tasks which involve learning and investigation activities. In my PhD research I aim to support different aspects of information seeking that are observed in exploratory activities. I propose a new framework based on combining knowledge graphs with document retrieval in order to effectively improve search breadth and quality.","PeriodicalId":447867,"journal":{"name":"Proceedings of the 5th Information Interaction in Context Symposium","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131535603","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"What does time constraint mean to information searchers?","authors":"Chang Liu, Fan Yang, Yu Zhao, Qin Jiang, Lu Zhang","doi":"10.1145/2637002.2637029","DOIUrl":"https://doi.org/10.1145/2637002.2637029","url":null,"abstract":"In this paper, we explore the relationship between time constraints and users' assessment of their search. A user experiment was conducted. Participants were asked to search under two conditions: with time constraint (TC) and with no time constraint (NTC). The results showed that time constraint did not significantly influence participants' assessment of task difficulty, but significantly influenced users' search confidence and their evaluation of search performance. Particularly, participants were less confident and considered their search performance worse in TC than in NTC conditions. We also found users acquired more new knowledge and had more positive affective states after searching in NTC than in TC conditions. Interestingly, we found time constraints also affect participants' anticipation of time needed to complete the task; participants thought they would need significantly less time to complete the search task when they were given time constraints than without time constraints. These preliminary results suggested that time constraints had remarkable influence upon users' perception of search tasks and their search experience.","PeriodicalId":447867,"journal":{"name":"Proceedings of the 5th Information Interaction in Context Symposium","volume":"91 2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132704151","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Adaptive search systems for web archive research","authors":"Hugo C. Huurdeman","doi":"10.1145/2637002.2637063","DOIUrl":"https://doi.org/10.1145/2637002.2637063","url":null,"abstract":"The wealth of digital information available in our time has become indispensable for a rich variety of tasks. We use data on the Web for work, leisure, and research, aided by various search systems, allowing us to find small needles in giant haystacks. Despite recent advances in personalization and contextualization, however, various types of tasks, ranging from simple lookup tasks to complex, exploratory and analytical ventures, are mainly supported in elementary, \"one-size-fits-all\" search interfaces. Web archives, keepers of our future cultural heritage, have gathered petabytes of valuable Web data, which characterize our times for future generations. Access to these archives, however, is surprisingly limited: online Web archives usually provide a URL-based Wayback Machine interface, sometimes extended with rudimentary search options. As a result of limited access, Web archives have not been widely used for research so far. For emerging research using Web archives, there is a need to move beyond URL-based and simple search access, towards providing support for complex (re)search tasks. In my thesis, I am exploring ways to move beyond the \"one-size-fits-all\" approach for search systems, and I work on systems which can support the flow of complex search, also in the context of archived Web data. Rich models of search and research can be incorporated into adaptive search systems, supporting search strategies in various stages of complex search tasks. Concretely, I look at the use case of the Humanities researcher, for which the large, Terabyte-scale Web archives can be a valuable addition to existing sources utilized to perform research.","PeriodicalId":447867,"journal":{"name":"Proceedings of the 5th Information Interaction in Context Symposium","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127329152","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A review of users' search contexts for lifelogging system design","authors":"Ying-Hsang Liu, R. Bierig","doi":"10.1145/2637002.2637040","DOIUrl":"https://doi.org/10.1145/2637002.2637040","url":null,"abstract":"The development of mobile and wearable technology has made it possible for people to collect and retrieve large amounts of data about their daily activities. We reviewed selected literature from four related research areas that actively engage in the investigation and modelling of users' search contexts. We discuss their similarities and their potential use for lifelogging. This paper represents a first step toward the conceptualisation of search contexts from an interdisciplinary perspective.","PeriodicalId":447867,"journal":{"name":"Proceedings of the 5th Information Interaction in Context Symposium","volume":"18 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131687007","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Information retrieval evaluation with humans in the loop","authors":"G. Kazai","doi":"10.1145/2637002.2637003","DOIUrl":"https://doi.org/10.1145/2637002.2637003","url":null,"abstract":"The evaluation and tuning of information retrieval (IR) systems based on the Cranfield paradigm requires purpose built test collections, which include sets of human contributed relevance labels, indicating the relevance of search results to a set of user queries. Traditional methods of collecting relevance labels rely on a fixed group of hired expert judges, who are trained to interpret user queries as accurately as possible and label documents accordingly. Human judges and the obtained relevance labels thus provide a critical link within the Cranfield style IR evaluation framework, where disagreement among judges and the impact of variable judgment sets on the final outcome of an evaluation is a well studied issue. There is also reported evidence that experiment outcomes can be affected by changes to the judging guidelines or changes in the judge population. Recently, the growing volume and diversity of the topics and documents to be judged is driving the increased adoption of crowdsourcing methods in IR evaluation, offering a viable alternative that scales with modest costs. In this model, relevance judgments are distributed online over a large population of humans, a crowd, facilitated, for example, by a crowdsourcing platform, such as Amazon's Mechanical Turk or Clickworker. Such platforms allow millions of anonymous crowd workers to be hired temporarily for micro-payments to complete so-called human intelligence tasks (HITs), such as labeling images or documents. Studies have shown that workers come from diverse backgrounds, work in a variety of different environments, and have different motivations. For example, users may turn to crowdsourcing as a way to make a living, to serve an altruistic or social purpose or simply to fill their time. They may become loyal crowd workers on one or more platforms, or they may leave after their first couple of encounters. Clearly, such a model is in stark contrast to the highly controlled methods that characterize the work of trained judges. For example, in a micro-task based crowdsourcing setup, worker training is usually minimal or non-existent. Furthermore, it is widely reported that labels provided by crowd workers can vary in quality, leading to noisy labels. Crowdsourcing can also suffer from undesirable worker behaviour and practices, e.g., dishonest behaviour or lack of expertise, that result in low quality contributions. While a range of quality assurance and control techniques have now been developed to reduce noise during or after task completion, little is known about the workers themselves and possible relationships between workers' characteristics, behaviour and the quality of their work. In this talk, I will review the findings of recent research that examines and compares trained judges and crowd workers hired to complete relevance assessment tasks of varying difficulty. The investigations include a range of aspects from how HIT design, judging instructions, worker demographics and charact","PeriodicalId":447867,"journal":{"name":"Proceedings of the 5th Information Interaction in Context Symposium","volume":"10 1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123763817","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Web search for instruction-related information: Why? Where? How?","authors":"Angela Vorndran, Christa Womser-Hacker, Marc Rittberger","doi":"10.1145/2637002.2637053","DOIUrl":"https://doi.org/10.1145/2637002.2637053","url":null,"abstract":"In this paper I would like to outline the theoretical concept, methods and research questions of my dissertation project. Following the theory of Information Use Environment by Taylor (1991) and its interpretation in the context of Web search by Detlor (2003), this investigation looks into the information behavior of teachers when searching the Web for instruction-related information. Typical problem situations of the work context are identified as well as relevant information traits and approaches to information search and use. Furthermore, the use of several search environments with different degrees of interactive character are analyzed comparatively. Taking into consideration a variety of data sources to gain a multi-perspective view on the issue, usage data of the German Education Server (GES) are analyzed in addition to discussion fora on teacher-specific websites and complemented by qualitative interviews.","PeriodicalId":447867,"journal":{"name":"Proceedings of the 5th Information Interaction in Context Symposium","volume":"50 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125241547","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}