Journal of the Association for Information Science and Technology最新文献_第2页

Death by AI: Will large language models diminish Wikipedia? 人工智能之死：大型语言模型会削弱维基百科吗？

IF 2.8 2区管理学

Journal of the Association for Information Science and Technology Pub Date : 2025-01-03 DOI: 10.1002/asi.24975

Christian Wagner, Ling Jiang

引用次数: 0

The use of bibliometrics for ranking the all-time greatest music artists 使用文献计量学对历史上最伟大的音乐艺术家进行排名

IF 2.8 2区管理学

Journal of the Association for Information Science and Technology Pub Date : 2024-12-30 DOI: 10.1002/asi.24976

Timothy L. Urban

引用次数: 0

A study of drag-and-drop query refinement and query history visualization for mobile exploratory search 移动探索性搜索的拖放查询细化和查询历史可视化研究

IF 2.8 2区管理学

Journal of the Association for Information Science and Technology Pub Date : 2024-12-30 DOI: 10.1002/asi.24977

Mohammad Hasan Payandeh, Orland Hoeber, Miriam Boon, Dale Storie, Veronica Ramshaw

{"title":"A study of drag-and-drop query refinement and query history visualization for mobile exploratory search","authors":"Mohammad Hasan Payandeh, Orland Hoeber, Miriam Boon, Dale Storie, Veronica Ramshaw","doi":"10.1002/asi.24977","DOIUrl":"https://doi.org/10.1002/asi.24977","url":null,"abstract":"When undertaking complex search scenarios, the underlying information need cannot be satisfied by finding a single optimal resource; instead, searchers need to engage in exploratory search processes to find multiple resources by iteratively revising and reformulation their queries. This process of query refinement is particularly challenging when using a mobile device, where typing is difficult. Furthermore, in mobile search contexts interruptions can lead to searchers losing track of what they were doing. To address these challenges, we designed a public digital library search interface for mobile devices that includes two novel features: drag-and-drop query refinement and query history visualization. To assess the value of this interface compared to a typical baseline, we conducted a controlled laboratory study with 32 participants that included pursuing complex search scenarios, being interrupted in the midst of the search, and resuming the search after the interruption. While participants took more time, they generated longer queries and reported positive subjective opinions about the usability of the exploratory search and task resumption features, along with a greater increase in certainty. These findings show the value of leveraging new touch-based interaction mechanisms within mobile search contexts, and the benefits that visualization can bring to supporting search task resumption.","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"76 6","pages":"848-866"},"PeriodicalIF":2.8,"publicationDate":"2024-12-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/asi.24977","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143900976","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Spoken conversational search: Evaluating the effect of system clarifications on user experience through Wizard-of-Oz study 口语会话搜索：通过“绿野仙踪”研究评估系统说明对用户体验的影响

IF 2.8 2区管理学

Journal of the Association for Information Science and Technology Pub Date : 2024-12-29 DOI: 10.1002/asi.24974

Souvick Ghosh, Chirag Shah

{"title":"Spoken conversational search: Evaluating the effect of system clarifications on user experience through Wizard-of-Oz study","authors":"Souvick Ghosh, Chirag Shah","doi":"10.1002/asi.24974","DOIUrl":"https://doi.org/10.1002/asi.24974","url":null,"abstract":"Prior research in human–computer interaction suggests that system-level clarifications are necessary for understanding user intent and communicating effectively with the user. Such clarifications or explanations could contain the system's abstract knowledge of the search or a functional description of the search process (queries and information sources employed). While these interactions may aid the user and the agent in better understanding each other, very few studies have explored the influence of such clarifications on the users' search experience. This research examines whether and how system-level clarifications (or explanations) affect the user experience when searching through spoken dialogues. We analyzed user satisfaction and preferences in systems with and without explicit clarifications in a within-subjects Wizard-of-Oz user study. We recruited 25 participants and collected user–system interaction data for 50 search sessions. The user feedback was collected using pre- and post-task surveys and exit interviews. Statistical and qualitative analysis of user responses yielded some interesting findings. While Wilcoxon Signed Rank Test found that using explicit system-level clarifications had no positive influence on the user's search experience, the overall search experience degraded with system clarifications (Z = −2.066, p = 0.04). The user interview data provided valuable insights into how and when clarifications should be offered to the user.","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"76 5","pages":"819-839"},"PeriodicalIF":2.8,"publicationDate":"2024-12-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143801495","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

College students' credibility assessments of GenAI-generated information for academic tasks: An interview study 大学生对基因人工智能生成的学术任务信息的可信度评估：一项访谈研究

IF 2.8 2区管理学

Journal of the Association for Information Science and Technology Pub Date : 2024-12-28 DOI: 10.1002/asi.24978

Wonchan Choi, Hyerin Bak, Jiaxin An, Yan Zhang, Besiki Stvilia

{"title":"College students' credibility assessments of GenAI-generated information for academic tasks: An interview study","authors":"Wonchan Choi, Hyerin Bak, Jiaxin An, Yan Zhang, Besiki Stvilia","doi":"10.1002/asi.24978","DOIUrl":"https://doi.org/10.1002/asi.24978","url":null,"abstract":"The study explored college students' use of generative artificial intelligence (GenAI) tools, such as ChatGPT, for academic tasks and their perceptions and behaviors in assessing the credibility of GenAI-generated information. Semistructured interviews were conducted with 25 college students in the United States. Interview transcripts were analyzed using the qualitative content analysis method. The study identified various types of academic tasks for which students used ChatGPT, including writing, programming, and learning. Guided by two models of credibility assessment Hilligoss and Rieh (2008); Metzger (2007), six factors influencing students' motivation and ability to assess the credibility of GenAI-generated information were identified (e.g., task salience, social pressure). We also identified 9 constructs (e.g., refinedness, explainability), 5 heuristics (e.g., inter- and intrasystem consistency heuristics), and 10 cues (e.g., version and tone) used by students to assess the credibility of GenAI-generated information. This study provides theoretical and empirical findings regarding students' use of GenAI tools in the academic context and credibility evaluation of the system outputs using rich, qualitative interview data.","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"76 6","pages":"867-883"},"PeriodicalIF":2.8,"publicationDate":"2024-12-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143900974","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Using the S-DIKW framework to transform data visualization into data storytelling 使用S-DIKW框架将数据可视化转换为数据叙述

IF 2.8 2区管理学

Journal of the Association for Information Science and Technology Pub Date : 2024-12-24 DOI: 10.1002/asi.24973

Angelica Lo Duca, Kate McDowell

{"title":"Using the S-DIKW framework to transform data visualization into data storytelling","authors":"Angelica Lo Duca, Kate McDowell","doi":"10.1002/asi.24973","DOIUrl":"https://doi.org/10.1002/asi.24973","url":null,"abstract":"Communicating insights from data effectively requires design skills, technical knowledge, and experience. Data must be accurately represented with aesthetically pleasing visuals and engaging text to effectively communicate to the intended audience. Data storytelling has received much attention lately, but as of yet, it does not have a theoretical and practical foundation in information science. A data story adds context, narrative, and structure to the visual representation of data, providing audiences with character, plot, and a holistic experience of narrative. This paper proposes a methodological approach to transform a data visualization into a data story based on the Data-Information-Knowledge-Wisdom (DIKW) pyramid and the S-DIKW Framework. Starting from the bottom of the pyramid, the proposed approach defines a strategy to represent insights extracted from data. Data is then turned into information by identifying character(s) facing a problem, adding textual and graphic content; information is turned into knowledge by organizing what happens as a plot. Finally, a call to wise action—always informed by cultural and community values—completes the storytelling transformation to create a data story. This article contributes to the theoretical understanding of data stories as emerging information forms, supporting richer understandings of a story as information in the information sciences.","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"76 5","pages":"803-818"},"PeriodicalIF":2.8,"publicationDate":"2024-12-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/asi.24973","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143801665","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Beyond decomposition: Hierarchical dependency management in multi-document question answering 超越分解：多文档问答中的分层依赖管理

IF 2.8 2区管理学

Journal of the Association for Information Science and Technology Pub Date : 2024-12-13 DOI: 10.1002/asi.24971

Xiaoyan Zheng, Zhi Li, Qianglong Chen, Yin Zhang

{"title":"Beyond decomposition: Hierarchical dependency management in multi-document question answering","authors":"Xiaoyan Zheng, Zhi Li, Qianglong Chen, Yin Zhang","doi":"10.1002/asi.24971","DOIUrl":"https://doi.org/10.1002/asi.24971","url":null,"abstract":"When using retrieval-augmented generation (RAG) to handle multi-document question answering (MDQA) tasks, it is beneficial to decompose complex queries into multiple simpler ones to enhance retrieval results. However, previous strategies always employ a one-shot approach of question decomposition, overlooking subquestions dependency problem and failing to ensure that the derived subqueries are single-hop. To overcome this challenge, we introduce a novel framework called DSRC-QCS. Decompose-solve-renewal-cycle (DSRC) is an iterative multi-hop question processing module. The key idea of DSRC involves using a unique symbol to achieve hierarchical dependency management and employing a cyclical process of question decomposition, solving, and renewal to continuously generate and resolve all single-hop subquestions. Query-chain selector (QCS) functions as a voting mechanism that effectively utilizes the reasoning process of DSRC to assess and select solutions. We compare DSRC-QCS against five RAG approaches across three datasets and three LLMs. DSRC-QCS demonstrates superior performance. Compared to the Direct Retrieval method, DSRC-QCS improves the average F1 score by 17.36% with Alpaca-7b, 10.83% with LLaMa2-Chat-7b, and 11.88% with GPT-3.5-Turbo. We also conduct ablation studies to validate the performance of both DSRC and QCS and explore factors influencing the effectiveness of DSRC. We have included all prompts in the Appendix.","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"76 5","pages":"770-789"},"PeriodicalIF":2.8,"publicationDate":"2024-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143801466","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Dynamic algorithmic awareness based on FAT evaluation: Heuristic intervention and multidimensional prediction 基于FAT评价的动态算法感知：启发式干预与多维预测

IF 2.8 2区管理学

Journal of the Association for Information Science and Technology Pub Date : 2024-12-06 DOI: 10.1002/asi.24969

Jing Liu, Dan Wu, Guoye Sun, Yuyang Deng

{"title":"Dynamic algorithmic awareness based on FAT evaluation: Heuristic intervention and multidimensional prediction","authors":"Jing Liu, Dan Wu, Guoye Sun, Yuyang Deng","doi":"10.1002/asi.24969","DOIUrl":"https://doi.org/10.1002/asi.24969","url":null,"abstract":"As the widespread use of algorithms and artificial intelligence (AI) technologies, understanding the interaction process of human–algorithm interaction becomes increasingly crucial. From the human perspective, algorithmic awareness is recognized as a significant factor influencing how users evaluate algorithms and engage with them. In this study, a formative study identified four dimensions of algorithmic awareness: conceptions awareness (AC), data awareness (AD), functions awareness (AF), and risks awareness (AR). Subsequently, we implemented a heuristic intervention and collected data on users' algorithmic awareness and FAT (fairness, accountability, and transparency) evaluation in both pre-test and post-test stages (N = 622). We verified the dynamics of algorithmic awareness and FAT evaluation through fuzzy clustering and identified three patterns of FAT evaluation changes: “Stable high rating pattern,” “Variable medium rating pattern,” and “Unstable low rating pattern.” Using the clustering results and FAT evaluation scores, we trained classification models to predict different dimensions of algorithmic awareness by applying different machine learning techniques, namely Logistic Regression (LR), Random Forest (RF), Support Vector Machine (SVM), Linear Discriminant Analysis (LDA), and XGBoost (XGB). Comparatively, experimental results show that the SVM algorithm accomplishes the task of predicting the four dimensions of algorithmic awareness with better results and interpretability. Its F1 scores are 0.6377, 0.6780, 0.6747, and 0.75. These findings hold great potential for informing human-centered algorithmic practices and HCI design.","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"76 4","pages":"718-739"},"PeriodicalIF":2.8,"publicationDate":"2024-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143622598","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Science for whom? The influence of the regional academic circuit on gender inequalities in Latin America 科学对谁有利？区域学术圈对拉丁美洲性别不平等的影响

IF 2.8 2区管理学

Journal of the Association for Information Science and Technology Pub Date : 2024-11-27 DOI: 10.1002/asi.24972

Carolina Pradier, Diego Kozlowski, Natsumi S. Shokida, Vincent Larivière

{"title":"Science for whom? The influence of the regional academic circuit on gender inequalities in Latin America","authors":"Carolina Pradier, Diego Kozlowski, Natsumi S. Shokida, Vincent Larivière","doi":"10.1002/asi.24972","DOIUrl":"https://doi.org/10.1002/asi.24972","url":null,"abstract":"The Latin-American scientific community has achieved significant progress towards gender parity, with nearly equal representation of women and men scientists. Nevertheless, women continue to be underrepresented in scholarly communication. Throughout the 20th century, Latin America established its academic circuit, focusing on research topics of regional significance. Through an analysis of scientific publications, this article explores the relationship between gender inequalities in science and the integration of Latin-American researchers into the regional and global academic circuits between 1993 and 2022. We find that women are more likely to engage in the regional circuit, while men are more active within the global circuit. This trend is attributed to a thematic alignment between women's research interests and issues specific to Latin America. Furthermore, our results reveal that the mechanisms contributing to gender differences in symbolic capital accumulation vary between circuits. Women's work achieves equal or greater recognition compared to men's within the regional circuit, but generally garners less attention in the global circuit. Our findings suggest that policies aimed at strengthening the regional academic circuit would encourage scientists to address locally relevant topics while simultaneously fostering gender equality in science.","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"76 5","pages":"790-802"},"PeriodicalIF":2.8,"publicationDate":"2024-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/asi.24972","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143801322","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Debunking war information disorder: A case study in assessing the use of multimedia verification tools 揭开战争信息混乱的面纱：评估多媒体核查工具使用情况的案例研究

IF 2.8 2区管理学

Journal of the Association for Information Science and Technology Pub Date : 2024-11-25 DOI: 10.1002/asi.24970

Sohail Ahmed Khan, Laurence Dierickx, Jan-Gunnar Furuly, Henrik Brattli Vold, Rano Tahseen, Carl-Gustav Linden, Duc-Tien Dang-Nguyen

{"title":"Debunking war information disorder: A case study in assessing the use of multimedia verification tools","authors":"Sohail Ahmed Khan, Laurence Dierickx, Jan-Gunnar Furuly, Henrik Brattli Vold, Rano Tahseen, Carl-Gustav Linden, Duc-Tien Dang-Nguyen","doi":"10.1002/asi.24970","DOIUrl":"https://doi.org/10.1002/asi.24970","url":null,"abstract":"This paper investigates the use of multimedia verification, in particular, computational tools and Open-source Intelligence (OSINT) methods, for verifying online multimedia content in the context of the ongoing wars in Ukraine and Gaza. Our study examines the workflows and tools used by several fact-checkers and journalists working at Faktisk, a Norwegian fact-checking organization. Our study showcases the effectiveness of diverse resources, including AI tools, geolocation tools, internet archives, and social media monitoring platforms, in enabling journalists and fact-checkers to efficiently process and corroborate evidence, ensuring the dissemination of accurate information. This research provides an in-depth analysis of the role of computational tools and OSINT methods for multimedia verification. It also underscores the potentials of currently available technology, and highlights its limitations while providing guidance for future development of digital multimedia verification tools and frameworks.","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"76 5","pages":"752-769"},"PeriodicalIF":2.8,"publicationDate":"2024-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/asi.24970","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143801360","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0