{"title":"Dynamic algorithmic awareness based on FAT evaluation: Heuristic intervention and multidimensional prediction","authors":"Jing Liu, Dan Wu, Guoye Sun, Yuyang Deng","doi":"10.1002/asi.24969","DOIUrl":"https://doi.org/10.1002/asi.24969","url":null,"abstract":"<p>As the widespread use of algorithms and artificial intelligence (AI) technologies, understanding the interaction process of human–algorithm interaction becomes increasingly crucial. From the human perspective, algorithmic awareness is recognized as a significant factor influencing how users evaluate algorithms and engage with them. In this study, a formative study identified four dimensions of algorithmic awareness: conceptions awareness (AC), data awareness (AD), functions awareness (AF), and risks awareness (AR). Subsequently, we implemented a heuristic intervention and collected data on users' algorithmic awareness and FAT (fairness, accountability, and transparency) evaluation in both pre-test and post-test stages (<i>N</i> = 622). We verified the dynamics of algorithmic awareness and FAT evaluation through fuzzy clustering and identified three patterns of FAT evaluation changes: “Stable high rating pattern,” “Variable medium rating pattern,” and “Unstable low rating pattern.” Using the clustering results and FAT evaluation scores, we trained classification models to predict different dimensions of algorithmic awareness by applying different machine learning techniques, namely Logistic Regression (LR), Random Forest (RF), Support Vector Machine (SVM), Linear Discriminant Analysis (LDA), and XGBoost (XGB). Comparatively, experimental results show that the SVM algorithm accomplishes the task of predicting the four dimensions of algorithmic awareness with better results and interpretability. Its F1 scores are 0.6377, 0.6780, 0.6747, and 0.75. These findings hold great potential for informing human-centered algorithmic practices and HCI design.</p>","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"76 4","pages":"718-739"},"PeriodicalIF":2.8,"publicationDate":"2024-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143622598","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Carolina Pradier, Diego Kozlowski, Natsumi S. Shokida, Vincent Larivière
{"title":"Science for whom? The influence of the regional academic circuit on gender inequalities in Latin America","authors":"Carolina Pradier, Diego Kozlowski, Natsumi S. Shokida, Vincent Larivière","doi":"10.1002/asi.24972","DOIUrl":"https://doi.org/10.1002/asi.24972","url":null,"abstract":"<p>The Latin-American scientific community has achieved significant progress towards gender parity, with nearly equal representation of women and men scientists. Nevertheless, women continue to be underrepresented in scholarly communication. Throughout the 20th century, Latin America established its academic circuit, focusing on research topics of regional significance. Through an analysis of scientific publications, this article explores the relationship between gender inequalities in science and the integration of Latin-American researchers into the regional and global academic circuits between 1993 and 2022. We find that women are more likely to engage in the regional circuit, while men are more active within the global circuit. This trend is attributed to a thematic alignment between women's research interests and issues specific to Latin America. Furthermore, our results reveal that the mechanisms contributing to gender differences in symbolic capital accumulation vary between circuits. Women's work achieves equal or greater recognition compared to men's within the regional circuit, but generally garners less attention in the global circuit. Our findings suggest that policies aimed at strengthening the regional academic circuit would encourage scientists to address locally relevant topics while simultaneously fostering gender equality in science.</p>","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"76 5","pages":"790-802"},"PeriodicalIF":2.8,"publicationDate":"2024-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/asi.24972","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143801322","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sohail Ahmed Khan, Laurence Dierickx, Jan-Gunnar Furuly, Henrik Brattli Vold, Rano Tahseen, Carl-Gustav Linden, Duc-Tien Dang-Nguyen
{"title":"Debunking war information disorder: A case study in assessing the use of multimedia verification tools","authors":"Sohail Ahmed Khan, Laurence Dierickx, Jan-Gunnar Furuly, Henrik Brattli Vold, Rano Tahseen, Carl-Gustav Linden, Duc-Tien Dang-Nguyen","doi":"10.1002/asi.24970","DOIUrl":"https://doi.org/10.1002/asi.24970","url":null,"abstract":"<p>This paper investigates the use of multimedia verification, in particular, computational tools and Open-source Intelligence (OSINT) methods, for verifying online multimedia content in the context of the ongoing wars in Ukraine and Gaza. Our study examines the workflows and tools used by several fact-checkers and journalists working at Faktisk, a Norwegian fact-checking organization. Our study showcases the effectiveness of diverse resources, including AI tools, geolocation tools, internet archives, and social media monitoring platforms, in enabling journalists and fact-checkers to efficiently process and corroborate evidence, ensuring the dissemination of accurate information. This research provides an in-depth analysis of the role of computational tools and OSINT methods for multimedia verification. It also underscores the potentials of currently available technology, and highlights its limitations while providing guidance for future development of digital multimedia verification tools and frameworks.</p>","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"76 5","pages":"752-769"},"PeriodicalIF":2.8,"publicationDate":"2024-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/asi.24970","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143801360","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Irene V. Pasquetto, Amina A. Abdu, Natascha Chtena
{"title":"Essential work, invisible workers: The role of digital curation in COVID-19 Open Science","authors":"Irene V. Pasquetto, Amina A. Abdu, Natascha Chtena","doi":"10.1002/asi.24965","DOIUrl":"https://doi.org/10.1002/asi.24965","url":null,"abstract":"<p>In this paper, we examine the role digital curation practices and practitioners played in facilitating open science (OS) initiatives amid the COVID-19 pandemic. In Summer 2023, we conducted a content analysis of available information regarding 50 OS initiatives that emerged—or substantially shifted their focus—between 2020 and 2022 to address COVID-19 related challenges. Despite growing recognition of the value of digital curation for the organization, dissemination, and preservation of scientific knowledge, our study reveals that digital curatorial work often remains invisible in pandemic OS initiatives. In particular, we find that, even among those initiatives that greatly invested in digital curation work, digital curation is seldom mentioned in mission statements, and little is known about the rationales behind curatorial choices and the individuals responsible for the implementation of curatorial strategies. Given the important yet persistent invisibility of digital curatorial work, we propose a shift in how we conceptualize digital curation from a practice that merely “adds value” to research outputs to a practice of knowledge production. We conclude with reflections on how iSchools can lead in professionalizing the field and offer suggestions for initial steps in that direction.</p>","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"76 4","pages":"703-717"},"PeriodicalIF":2.8,"publicationDate":"2024-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/asi.24965","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143622559","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Information avoidance: A critical conceptual review. An Annual Review of Information Science and Technology (ARIST) paper","authors":"Alison Hicks, Pamela McKenzie, Jenny Bronstein, Jette Seiden Hyldegård, Ian Ruthven, Gunilla Widén","doi":"10.1002/asi.24968","DOIUrl":"https://doi.org/10.1002/asi.24968","url":null,"abstract":"<p>Information avoidance has long been in the shadow of information seeking. Variously seen as undesired, maladaptive, or even pathological, information avoidance has lacked the sustained attention and conceptualization that has been provided to other information practices. It is also, perhaps uniquely among information practices, often invoked to blame or censure those who engage in it. However, closer examination of information avoidance reveals nuanced and complex patterns of interactions with information, ones that often have positive and beneficial outcomes. We challenge the simplistic tenor of this conversation through this critical conceptual review of information avoidance. Starting from an examination of how information avoidance has been treated within information science and related disciplines, we then draw upon the various terms that have been used to describe a lack of engagement with information to establish seven core characteristics of the concept. We subsequently use this analysis to establish our definition of information avoidance as practices that moderate interaction with information by reducing the intensity of information, restricting control over information, and/or excluding information based on perceived properties. We consider the implications of this definition and its view of information avoidance as a significant information practice on information research.</p>","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"76 1","pages":"326-346"},"PeriodicalIF":2.8,"publicationDate":"2024-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/asi.24968","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143117897","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"“I wish I could use any language as it comes to mind”: User experience in digital platforms in the context of multilingual personal information management","authors":"Lilach Alon, Maja Krtalić","doi":"10.1002/asi.24964","DOIUrl":"https://doi.org/10.1002/asi.24964","url":null,"abstract":"<p>In today's linguistically diverse world, managing personal information across multiple languages presents a challenge. This study engaged 16 multilingual participants to explore their user experience in the context of multilingual personal information management (MPIM), with a focus on inclusivity, universality, and equity. Addressing two main questions, the study explores the challenges users face on digital platforms in MPIM contexts and their ideal platform features. Findings highlight key issues in MPIM platform design, including unsupported languages and integration of visual aesthetics. We also identify user preferences for ideal platform features, such as language flexibility and efficient information retrieval. The study suggests the need for more inclusive, universal, and equitable platform designs that cater to the specific requirements of multilingual users. Ultimately, this study underscores the critical need for improved MPIM support and emphasizes the significance of continued exploration in this area, establishing it as a vital field of future research.</p>","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"76 4","pages":"686-702"},"PeriodicalIF":2.8,"publicationDate":"2024-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143622279","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"ChatGPT for complex text evaluation tasks","authors":"Mike Thelwall","doi":"10.1002/asi.24966","DOIUrl":"https://doi.org/10.1002/asi.24966","url":null,"abstract":"<p>ChatGPT and other large language models (LLMs) have been successful at natural and computer language processing tasks with varying degrees of complexity. This brief communication summarizes the lessons learned from a series of investigations into its use for the complex text analysis task of research quality evaluation. In summary, ChatGPT is very good at understanding and carrying out complex text processing tasks in the sense of producing plausible responses with minimum input from the researcher. Nevertheless, its outputs require systematic testing to assess their value because they can be misleading. In contrast to simple tasks, the outputs from complex tasks are highly varied and better results can be obtained by repeating the prompts multiple times in different sessions and averaging the ChatGPT outputs. Varying ChatGPT's configuration parameters from their defaults does not seem to be useful, except for the length of the output requested.</p>","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"76 4","pages":"645-648"},"PeriodicalIF":2.8,"publicationDate":"2024-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/asi.24966","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143622691","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Associating cognitive abilities with naturalistic search behavior","authors":"Tung Vuong, Pritom Kumar Das, Tuukka Ruotsalo","doi":"10.1002/asi.24963","DOIUrl":"https://doi.org/10.1002/asi.24963","url":null,"abstract":"<p>Differences in cognitive abilities affect search behaviors, but this has mostly been observed in laboratory experiments. There is limited research on how users search for information in real-world, naturalistic settings and how real-world search behaviors relate to cognitive abilities. In this study, we investigated a wide range of behavioral data captured from real-life search tasks, their association with users' cognitive abilities, and the potential for automatically inferring cognitive abilities from these data. Furthermore, we aimed to determine the data quantity and monitoring duration needed to effectively estimate cognitive abilities from naturalistic behavior. Twenty individuals with βvarying cognitive abilities participated in the experiments in which their everyday search behavior was continuously recorded for 14 days. Their cognitive ability was evaluated through standard tests conducted individually. Data consisted of over 800 h of monitoring, including 2022 queries extracted from 1,442,447 screen frames and associated operating system logs. Using these data, naturalistic search behaviors were associated with cognitive abilities, and predictive models were trained. The results showed that lower selective attention was found to be associated with longer dwelling on selected search results. Faster psychomotor speed and higher fluid intelligence were found to be associated with a greater amount of text read on selected pages. Predictive models exhibited small error rates in predicting cognitive abilities.</p>","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"76 4","pages":"665-685"},"PeriodicalIF":2.8,"publicationDate":"2024-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/asi.24963","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143622444","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Anthony J. Million, Jeremy York, Sara Lafia, Libby Hemphill
{"title":"Data, not documents: Moving beyond theories of information-seeking behavior to advance data discovery","authors":"Anthony J. Million, Jeremy York, Sara Lafia, Libby Hemphill","doi":"10.1002/asi.24962","DOIUrl":"https://doi.org/10.1002/asi.24962","url":null,"abstract":"<p>Many theories of human information behavior (HIB) assume that information objects are in text document format. This paper argues four important HIB theories are insufficient for describing users' search strategies for data because of assumptions about the attributes of objects that users seek. We first review and compare four HIB theories: Bates' <i>berrypicking</i>, Marchionni's <i>electronic information search</i>, Dervin's <i>sense-making</i>, and Meho and Tibbo's <i>social scientist information-seeking</i>. All four theories assume that information-seekers search for text documents. Next, we compare these theories to search behavior by analyzing Google Analytics data from the Inter-university Consortium for Political and Social Research (ICPSR). Users took direct, scenic, and orienting paths when searching for data. We also interviewed ICPSR users (<i>n</i> = 20), and they said they needed dataset documentation and contextual information to find data. However, Dervin's <i>sense-making</i> alone cannot explain the information-seeking behaviors that we observed. Instead, what mattered most were object attributes determined by the type of information that users sought (i.e., data, not documents). We conclude by suggesting an alternative frame for building user-centered data discovery tools.</p>","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"76 4","pages":"649-664"},"PeriodicalIF":2.8,"publicationDate":"2024-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/asi.24962","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143622443","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Katrina Fenlon, Peter Organisciak, Andrea Thomer, Nicholas M. Weber
{"title":"Conceptual models of the sociotechnical: Introduction to special issue","authors":"Katrina Fenlon, Peter Organisciak, Andrea Thomer, Nicholas M. Weber","doi":"10.1002/asi.24958","DOIUrl":"https://doi.org/10.1002/asi.24958","url":null,"abstract":"<p>This special issue of the “Journal of the Association for Information Science and Technology” examines conceptual models as products of, and tools for, critical inquiry in Information Science (IS). The papers included in this issue present diverse perspectives on how conceptual models impact sociotechnical systems, spanning topics such as knowledge organization, representation, and information system design. Key themes include the intersection of model development with ethical considerations, the historical and future implications of conceptual modeling decisions, and the potential for conceptual models to address issues of power, representation, and justice in emerging technologies. This introduction situates the contributions within broader discussions of conceptual modeling in IS and highlights the field's unique approach to reflexive critique and sociotechnical analysis.</p>","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"76 2","pages":"349-352"},"PeriodicalIF":2.8,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143111890","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}