{"title":"How much freedom does an effectiveness metric really have?","authors":"Alistair Moffat, Joel Mackenzie","doi":"10.1002/asi.24874","DOIUrl":"10.1002/asi.24874","url":null,"abstract":"<p>It is tempting to assume that because effectiveness metrics have free choice to assign scores to search engine result pages (SERPs) there must thus be a similar degree of freedom as to the relative order that SERP pairs can be put into. In fact that second freedom is, to a considerable degree, illusory. That is because if one SERP in a pair has been given a certain score by a metric, fundamental ordering constraints in many cases then dictate that the score for the second SERP must be either not less than, or not greater than, the score assigned to the first SERP. We refer to these fixed relationships as <i>innate pairwise SERP orderings</i>. Our first goal in this work is to describe and defend those pairwise SERP relationship constraints, and tabulate their relative occurrence via both exhaustive and empirical experimentation. We then consider how to employ such innate pairwise relationships in IR experiments, leading to a proposal for a new measurement paradigm. Specifically, we argue that tables of results in which many different metrics are listed for champion versus challenger system comparisons should be avoided; and that instead a single metric be argued for in principled terms, with any relationships identified by that metric then reinforced via an assessment of the innate relationship as to whether other metrics are likely to yield the same system-versus-system outcome.</p>","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"75 6","pages":"686-703"},"PeriodicalIF":3.5,"publicationDate":"2024-02-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/asi.24874","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139924795","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Junwan Liu, Xiaofei Guo, Shuo Xu, Yi Bu, Cassidy R. Sugimoto, Vincent Larivière, Yinglu Song, Honghao Zhou
{"title":"Understanding super-partnerships in scientific collaboration: Evidence from the field of economics","authors":"Junwan Liu, Xiaofei Guo, Shuo Xu, Yi Bu, Cassidy R. Sugimoto, Vincent Larivière, Yinglu Song, Honghao Zhou","doi":"10.1002/asi.24876","DOIUrl":"10.1002/asi.24876","url":null,"abstract":"<p>Super-partnerships exist between scholars connected within densely-knit collaboration networks. Understanding how such relationships affect scholars' careers is of great importance. In this paper, focusing on the longitudinal aspects of scientific collaboration, we analyze collaboration profiles from the egocentric perspective and use analytic extreme value thresholds to identify super-partners. A total of 5722 pairs of super-partners are found in the field of economics. The several interesting findings about super-partners are summarized as follows. (1) The collaboration pattern of super-partners can be divided into three types: the dual-core, bridge, and triangle types. (2) Gender disparities are reflected in the collaboration among super-partners, and the stability of super-partnerships involving different combinations of genders displays different characteristics. The random-effect model is constructed to explore the effect of a super-partnership on both parties from the aspects of productivity and influence, which also shows gender disparities. (3) A super-partnership contributes to above-average productivity and citation impacts of the publication for three collaboration patterns, and the research improvement of the triangle type is the greatest among the three types. Overall, this paper explores the characteristics of super-partners and the added value of a long-term commitment, which provides quantitative insights into the effect on scientific collaboration associated with close collaboration.</p>","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"75 6","pages":"717-733"},"PeriodicalIF":3.5,"publicationDate":"2024-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139759264","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Semiotic scale for library software interfaces: Development and validation","authors":"Manoj Kumar Verma, Vinit Kumar, Mayank Yuvaraj","doi":"10.1002/asi.24875","DOIUrl":"10.1002/asi.24875","url":null,"abstract":"<p>This study presents a significant advancement in the realm of information science by exploring and validating a semiotic scale tailored for library software interfaces. Employing a design-based approach, the investigation identifies 14 crucial semiotic elements specific to library software interfaces, forming the cornerstone of its theoretical framework. The process of developing the semiotic scale involves creating user personas, conducting a comprehensive semiotic analysis, and engaging in productive collaboration with experts. Through meticulous evaluation and refinement, achieved by expert assessments and user testing, the scale offers actionable insights for guiding interface enhancement. The study's findings encompass a breadth of revelations, including user needs, user personas, outcomes of semiotic analysis, criteria development, and evaluation results across a diverse range of library software interfaces. Serving as a valuable tool for interface designers, the semiotic scale facilitates the alignment of design choices with user preferences and requirements. Its inherent adaptability ensures applicability across a spectrum of library software interfaces. The study's paramount contribution lies in bridging the gap between theoretical semiotics and practical design considerations. The comprehensive model offered by the development and validation of the semiotic scale empowers the evaluation of semiotic elements' impact on user perceptions and interface usability.</p>","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"75 6","pages":"704-716"},"PeriodicalIF":3.5,"publicationDate":"2024-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139793403","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Centering dialog and care in digital Indigenous knowledge stewardship: Of relationality, responsibility, and respect","authors":"Chern Li Liew, Ailsa Lipscombe","doi":"10.1002/asi.24873","DOIUrl":"10.1002/asi.24873","url":null,"abstract":"<p>The question of how to appropriately care for and share Indigenous knowledges is central to cultural heritage documentation and, contemporary archival praxes and discourses. Transforming the standards of Indigenous knowledge management (IKM) necessitates confronting the legacies of colonial control and Indigenous expurgation that settler colonial galleries, libraries, archives, and museums (GLAM) have contributed to (intentionally or not). Writing of and within the Māori context in New Zealand, we argue that a renewed orientation toward dialogic collaboration between institutions and Indigenous communities is crucial for revitalizing archival practices and partnerships in ways that center Indigenous values. Moreover, we purport that aligning institutional practices with Indigenous values is insufficient if Indigenous communities are neither made to feel welcome within archival spaces nor empowered to utilize them. As such, we identify the notions of relationality, responsibility, and respect as vital in supporting this ethical transformation of Indigenous knowledge stewardship both in New Zealand and in other Indigenous contexts. We propose that current efforts to reshape IKM praxes in culturally responsible and responsive ways can be meaningfully expanded through dialogic engagement, and an ethics of care.</p>","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"75 6","pages":"671-685"},"PeriodicalIF":3.5,"publicationDate":"2024-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/asi.24873","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139792167","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Will sentiment analysis need subculture? A new data augmentation approach","authors":"Zhenhua Wang, Simin He, Guang Xu, Ming Ren","doi":"10.1002/asi.24872","DOIUrl":"10.1002/asi.24872","url":null,"abstract":"<p>Nowadays, the omnipresence of the Internet has fostered a subculture that congregates around the contemporary milieu. The subculture artfully articulates the intricacies of human feelings by ardently pursuing the allure of novelty, a fact that cannot be disregarded in the sentiment analysis. This paper aims to enrich data through the lens of subculture, to address the insufficient training data faced by sentiment analysis. To this end, a new approach of subculture-based data augmentation (SCDA) is proposed, which engenders enhanced texts for each training text by leveraging the creation of specific subcultural expression generators. The extensive experiments attest to the effectiveness and potential of SCDA. The results also shed light on the phenomenon that disparate subcultural expressions elicit varying degrees of sentiment stimulation. Moreover, an intriguing conjecture arises, suggesting the linear reversibility of certain subcultural expressions.</p>","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"75 6","pages":"655-670"},"PeriodicalIF":3.5,"publicationDate":"2024-01-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139562319","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Information shaping","authors":"Ian Ruthven","doi":"10.1002/asi.24871","DOIUrl":"10.1002/asi.24871","url":null,"abstract":"<p>In this article, I explore the relationships between how humans have evolved to interact with the material world and how we interact with our information worlds. I argue that shaping processes, exemplified by how early humans created stone tools, are core ways to interact with the world that are appropriated to interact with information to create information solutions. To test these claims, I examine existing studies of information use from a shaping perspective. I finish by discussing how this evolutionary perspective to information use can benefit discussions of information behavior.</p>","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"75 4","pages":"469-482"},"PeriodicalIF":3.5,"publicationDate":"2024-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/asi.24871","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139498865","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Information sculpting","authors":"Ian Ruthven","doi":"10.1002/asi.24864","DOIUrl":"10.1002/asi.24864","url":null,"abstract":"<p>In this paper, I propose sculpting as an analogy for information use. I provide a background to the use of metaphors and analogies in Information Science, propose five analogical mappings between sculpting and information use, and then discuss the benefits to this analogy for thinking about how we use information.</p>","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"75 4","pages":"483-495"},"PeriodicalIF":3.5,"publicationDate":"2024-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/asi.24864","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139498925","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Deen Freelon, Meredith L. Pruden, Daniel Malmer, Qunfang Wu, Yiping Xia, Daniel Johnson, Emily Chen, Andrew Crist
{"title":"What's in your PIE? Understanding the contents of personalized information environments with PIEGraph","authors":"Deen Freelon, Meredith L. Pruden, Daniel Malmer, Qunfang Wu, Yiping Xia, Daniel Johnson, Emily Chen, Andrew Crist","doi":"10.1002/asi.24869","DOIUrl":"10.1002/asi.24869","url":null,"abstract":"<p>Social media have long been studied from <i>platform-centric</i> perspectives, which entail sampling messages based on criteria such as keywords and specific accounts. In contrast, <i>user-centric</i> approaches attempt to reconstruct the personalized information environments users create for themselves. Most user-centric studies analyze what users have accessed directly through browsers (e.g., through clicks) rather than what they may have seen in their social media feeds. This study introduces a data collection system of our own design called PIEGraph that links survey data with posts collected from participants' personalized X (formerly known as Twitter) timelines. Thus, in contrast with previous research, our data include much more than what users decide to click on. We measure the total amount of data in our participants' respective feeds and conduct descriptive and inferential analyses of three other quantities of interest: political content, ideological skew, and fact quality ratings. Our results are relevant to ongoing debates about digital echo chambers, misinformation, and conspiracy theories; and our general methodological approach could be applied to social media beyond X/Twitter contingent on data availability.</p>","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"75 10","pages":"1119-1133"},"PeriodicalIF":2.8,"publicationDate":"2024-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139462965","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Phenomenon-based classification: An Annual Review of Information Science and Technology (ARIST) paper","authors":"Claudio Gnoli, Richard P. Smiraglia, Rick Szostak","doi":"10.1002/asi.24865","DOIUrl":"10.1002/asi.24865","url":null,"abstract":"<p>While bibliographic classifications are traditionally based on disciplines, the logical alternative is phenomenon-based classification. Although not prevalent, this approach has been explored in the 20th century by J.D. Brown, the Classification Research Group, and others. Its principles have been stated in the León Manifesto (2007) and are currently represented by such general schemes as the Basic Concepts Classification and the Integrative Levels Classification. A phenomenon-based classification lists classes of phenomena, including things and processes irrespective of the discipline studying them (which can optionally be specified as an additional facet). Facets can work in a phenomenon-based system much as in a disciplinary one. This kind of system will promote the identification of potential relationships between research in different disciplines, and will especially benefit interdisciplinary work. The paper reviews the theory, history, structure, advantages, applications, and evaluation of phenomenon-based classification systems.</p>","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"75 3","pages":"324-343"},"PeriodicalIF":3.5,"publicationDate":"2024-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/asi.24865","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139421461","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Socio-technical issues in the platform-mediated gig economy: A systematic literature review: An Annual Review of Information Science and Technology (ARIST) paper","authors":"Meredith Dedema, Howard Rosenbaum","doi":"10.1002/asi.24868","DOIUrl":"10.1002/asi.24868","url":null,"abstract":"<p>The gig economy and gig work have grown quickly in recent years and have drawn much attention from researchers in different fields. Because the platform mediated gig economy is a relatively new phenomenon, studies have produced a range of interesting findings; of interest here are the socio-technical issues that this work has surfaced. This systematic literature review (SLR) provides a snapshot of a range of socio-technical issues raised in the last 12 years of literature focused on the platform mediated gig economy. Based on a sample of 515 papers gathered from nine databases in multiple disciplines, 132 were coded that specifically studied the gig economy, gig work, and gig workers. Three main socio-technical themes were identified: (1) the digital workplace, which includes information infrastructure and digital labor that are related to the nature of gig work and the user agency; (2) algorithmic management, which includes platform governance, performance management, information asymmetry, power asymmetry, and system manipulation, relying on a diverse set of technological tools including algorithms and big data analytics; (3) ethical design, as a relevant value set that gig workers expect from the platform, which includes trust, fairness, equality, privacy, and transparency. A social informatics perspective is used to rethink the relationship between gig workers and platforms, extract the socio-technical issues noted in prior research, and discuss the underexplored aspects of the platform mediated gig economy. The results draw attention to understudied yet critically important socio-technical issues in the gig economy that suggest short- and long-term opportunities for future research directions.</p>","PeriodicalId":48810,"journal":{"name":"Journal of the Association for Information Science and Technology","volume":"75 3","pages":"344-374"},"PeriodicalIF":3.5,"publicationDate":"2024-01-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/asi.24868","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139414796","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}