Performance Measurement and Metrics最新文献

{"title":"Global Libraries impact planning and assessment progress: part 2","authors":"D. Streatfield, Richard Abisla, Umut Al, V. Bunescu, Yulianto Dewata, Camila Garroux, Daniela Greeb, Artiom Maister, J. Paley, Shipra Sharma, Tripti Sharma, Irem Soydal, T. Trần","doi":"10.1108/PMM-03-2019-0007","DOIUrl":"https://doi.org/10.1108/PMM-03-2019-0007","url":null,"abstract":"\u0000Purpose\u0000The purpose of this paper is to report on recent performance measurement and impact evaluation progress made in Brazil, India, Indonesia, Moldova, Turkey and Vietnam as part of the last phase of the Global Libraries Initiative.\u0000\u0000\u0000Design/methodology/approach\u0000The country reports are presented as a series of case studies, in some cases supplementing those reported earlier in this journal.\u0000\u0000\u0000Findings\u0000Recent country-specific survey findings are reported and some conclusions are offered.\u0000\u0000\u0000Research limitations/implications\u0000This paper demonstrates how the adoption of a common approach to library service evaluation across several countries can strengthen research practice at country level beyond the Global Libraries Initiative itself.\u0000\u0000\u0000Practical implications\u0000This paper shares Global Libraries IPA learning at country level with people in other countries who may be contemplating public library evaluation at regional, national or local levels or who are interested in performance measurement and impact evaluation.\u0000\u0000\u0000Social implications\u0000The paper shows how focusing on the impact of public library services on users can enhance the understanding of community requirements and inform the development of more effective services to library users and communities.\u0000\u0000\u0000Originality/value\u0000These case studies reflect concentrated impact evaluation and performance measurement work at country level across a range of countries over more than 18 years.\u0000","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":" ","pages":""},"PeriodicalIF":1.1,"publicationDate":"2019-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1108/PMM-03-2019-0007","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43180666","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Innovative impact planning and assessment through global libraries","authors":"David Streatfield,Richard Abisla,Violeta Bunescu,Marcel Chiranov,Camila Garroux,Artiom Maister,Luis González Martín,Jeremy Paley,Simon Rae-Scott","doi":"10.1108/pmm-03-2019-0010","DOIUrl":"https://doi.org/10.1108/pmm-03-2019-0010","url":null,"abstract":"PurposeThe purpose of this paper is to report a range of innovative approaches, methods and tools for evaluating the impact of public libraries and supporting the development of library leaders drawn from projects supported by the Global Libraries initiative of the Bill and Melinda Gates Foundation.Design/methodology/approachA range of approaches, tools and methods are described by specialist staff who were directly involved with these innovations.FindingsSome comments are provided on the effectiveness of these innovations.Research limitations/implicationsAll of these innovations have been tried out in public library settings, usually over a period of years.Practical implicationsAll of the selected innovations could be adapted and used by library leaders or impact specialists.Social implicationsSeveral of the innovations are specifically designed to engage library staff and users in evaluation processes.Originality/valueThe impact planning and assessment programme of GL was the largest sustained international public library evaluation programme so far attempted. This paper reports on the more innovative evaluation activities undertaken through this programme.","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":"40 8","pages":"74-84"},"PeriodicalIF":1.1,"publicationDate":"2019-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138507791","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Investigating first-generation students’ perceptions of library personnel","authors":"Steve Borrelli, Chao Su, S. Selden, Lana Munip","doi":"10.1108/PMM-07-2018-0018","DOIUrl":"https://doi.org/10.1108/PMM-07-2018-0018","url":null,"abstract":"PurposeThe purpose of this paper is to investigate the perceived role of library personnel in supporting first-generation students at Penn State University Libraries, and also how students’ perceptions of library personnel change over time, and the various experiences that influenced their changes in perception.Design/methodology/approachThis study employed focus groups to solicit input from first-generation students. A four-step team-based approach to qualitative coding process was developed including the development of a codebook informed by common themes and concepts drawn from the literature.FindingsFindings indicate that operating from a deficit of library cultural capital often results in low awareness of available services and changes in perception are more influenced by personal exploration than limited interactions with personnel. Further, while currently employed interventions are well targeted, opportunities exist for enhancing efforts.Research limitations/implicationsAs this is a case study, the findings are not generalizable. Per conducting only four focus groups, the experiences of participants may not represent the typical scope of personnel-related interactions.Originality/valueThis study adds to the limited body of evidence that first-generation students’ struggle from a deficit of library-related cultural capital.","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":"1 1","pages":""},"PeriodicalIF":1.1,"publicationDate":"2019-02-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1108/PMM-07-2018-0018","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41481345","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Revision of an academic library user experience survey","authors":"Beyza Aksu Dunya, S. D. Groote","doi":"10.1108/PMM-10-2018-0026","DOIUrl":"https://doi.org/10.1108/PMM-10-2018-0026","url":null,"abstract":"\u0000Purpose\u0000The purpose of this paper is to explain how an academic library’s Student Experience Survey was revised and improved based on available research on survey design methodology and piloting efforts. Thus, it aims to contribute existing literature on library assessment and survey methodology by addressing issues of planning and coordinating assessment. The paper also provides a guideline on the survey revision process for existing instruments.\u0000\u0000\u0000Design/methodology/approach\u0000The library assessment coordinator collaborated with Assessment Coordinator Advisory Committee (AC2) to revise and improve the survey. The revision process started with adding suggested items and constructing new items based on library assessment planning survey administered to library faculty previously. Regular monthly meetings were held with the committee to facilitate the revision process. Multiple facets of the survey implementation were revised including wording, content, order and format of the items, response scales and survey distribution. Each facet was addressed based on available research on survey methodology and cross-checked with the committee members.\u0000\u0000\u0000Findings\u0000The revised 2018 University of Illinois at Chicago (UIC) Libraries Student Experience Survey consists of a total of nine items with response matrices, single choice response format and open-ended response format to measure students’ satisfaction, need and their use of the various library resources and services. The changes made to the survey are grouped into three categories: wording and content, response categories and scaling and design, font and layout. The revision process of the UIC Libraries Student Experience Survey can serve as an example for academic or other types of libraries that wish to track and report their impact regularly.\u0000\u0000\u0000Originality/value\u0000The UIC Libraries Student Experience Survey provides evidence that careful revision and piloting as well as obtaining relevant stakeholder buy-in to the process lead to build effective survey tools.\u0000","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":" ","pages":""},"PeriodicalIF":1.1,"publicationDate":"2019-02-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1108/PMM-10-2018-0026","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47168359","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Bibliometric assessment of the global research output inJatropha curcas Linnas reflected by papers indexed in Science Citation Index-Expanded","authors":"K. C. Garg, Suresh Kumar","doi":"10.1108/PMM-07-2018-0019","DOIUrl":"https://doi.org/10.1108/PMM-07-2018-0019","url":null,"abstract":"PurposeThe purpose of this paper is to examine the quantum of research papers and the citations these papers received for the plantJatropha curcas Linn.Design/methodology/approachArticles published onJatropha curcas Linnduring 1987–2016 were downloaded from Science Citation Index-Expanded (SCIE) by using the keyword Jatropha* on October 18, 2017. The search resulted in 4,276 records in all. The authors analyzed only 4,111 documents which were published as review articles, research articles and proceeding papers using the complete count methodology. The data were analyzed to examine the pattern of growth of output, most prolific countries, institutions and authors. It also identified highly cited authors and journals used for communicating research results.FindingsThe study indicates that India, China and Brazil are the main contributors to the field and the pattern of growth indicates a steep rise in publication output especially in the last block of 2015–2016. Most of the prolific institutions and authors were also located in these countries. However, the impact of output was different from the pattern of output. The publication output is scattered in more than 1,000 journals published from different parts of the globe.Originality/valueThe plant ofJatropha curcas Linnis a highly useful plant as a source of biofuel energy. This is the second study in English language on this plant and has used a large set of publication data as compared to the first. The findings of the study may be useful for policy makers as well as for researchers working in the field of biofuel energy.","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":" ","pages":""},"PeriodicalIF":1.1,"publicationDate":"2019-02-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1108/PMM-07-2018-0019","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47384405","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Evaluating library service quality of University of Kashmir: a LibQUAL+ survey","authors":"Anil Kumar, P. Mahajan","doi":"10.1108/PMM-09-2018-0024","DOIUrl":"https://doi.org/10.1108/PMM-09-2018-0024","url":null,"abstract":"\u0000Purpose\u0000The purpose of this paper is to evaluate the library service quality (LSQ) of University of Kashmir from the users’ perspectives based on the LibQUAL+ model approach.\u0000\u0000\u0000Design/methodology/approach\u0000The survey used the LibQUAL+ model to evaluate service quality (SQ) of Allama Iqbal Library (AIL), University of Kashmir, Srinagar (India). The data were collected from library users by administering the LibQUAL+ questionnaire in a printed format.\u0000\u0000\u0000Findings\u0000It has been revealed that AIL has succeeded in satisfying the minimum expectations of its users but could not meet the customers’ desired expectations that make them delighted. Library as Place (LP) and Information Control (IC) are the most satisfied dimensions of SQ of AIL, whereas Affect of Service (AS) is the least satisfied dimension. LP is the most desired dimension amongst LibQUAL+ dimensions. All LibQUAL+ items were found to be lying inside the zone of tolerance (ZoT). Further, “Library is secure and peaceful place for study, learning and research” (LP-21) was found as most important service item as per users’ desired expectations, while “Library staff shows dependability in handling users’ service problems” (AS-9) is marked as the least desired item.\u0000\u0000\u0000Originality/value\u0000Only a few studies have been carried out to evaluate the SQ of Indian university libraries as far as the LibQUAL+ model is concerned. Therefore, the findings of present survey will help to understand how far library has reached in satisfying users’ expectations as well as the areas or dimensions where it needs to improve.\u0000","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":" ","pages":""},"PeriodicalIF":1.1,"publicationDate":"2019-02-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1108/PMM-09-2018-0024","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41560447","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Information science’s contributions towards emerging open evaluation practices","authors":"Leonor Gaspar Pinto, P. Ochôa","doi":"10.1108/PMM-05-2018-0015","DOIUrl":"https://doi.org/10.1108/PMM-05-2018-0015","url":null,"abstract":"\u0000Purpose\u0000The purpose of this paper is to discuss emerging practices in open evaluation, namely, the concept of co-evaluation and how research on evaluation developed within information science can contribute to enhance stakeholders and citizens’ involvement in open science.\u0000\u0000\u0000Design/methodology/approach\u0000A meta-evaluative and transdisciplinary approach – directed toward the intersection between information science, evaluation, competences management, sustainability transitions management and participatory methodologies – provided the basis for the identification and subsequent reflection on the levels of stakeholder participation embedded into ISO 16439’s (2014) methods for assessing the impact of libraries and on the domains and competences to be mobilized for (co)evaluation. The contributions of Engaged 2020 Action Catalogue, as well as several taxonomies of evaluator competences and the Council of Europe’s (2016) conceptual model of competences for a democratic culture were particularly relevant for this (re)construction process.\u0000\u0000\u0000Findings\u0000Two results of the line of research carried out since 2012 at the Faculty of Social Sciences and Humanities of the Universidade NOVA de Lisboa (Portugal) can significantly contribute to improve stakeholders’ participation in Open Science: ISO 16439’s systematization of methods and procedures for assessing the impact of libraries and the (co-)evaluation competency framework.\u0000\u0000\u0000Originality/value\u0000This paper presents the transdisciplinary concept of co-evaluation and examines the current epistemological challenges to science by analyzing the general tendency to openness through the lens of research on evaluation and participatory methods developed within information science.\u0000","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":" ","pages":""},"PeriodicalIF":1.1,"publicationDate":"2019-02-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1108/PMM-05-2018-0015","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42767442","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Usage, captures, mentions, social media and citations of LIS highly cited papers: an altmetrics study","authors":"M. Saberi, Faezeh Ekhtiyari","doi":"10.1108/PMM-10-2018-0025","DOIUrl":"https://doi.org/10.1108/PMM-10-2018-0025","url":null,"abstract":"\u0000Purpose\u0000The purpose of this paper is to investigate the usage, captures, mentions, social media and citations of highly cited papers of Library and information science (LIS).\u0000\u0000\u0000Design/methodology/approach\u0000This study is quantitative research that was conducted using scientometrics and altmetrics indicators. The research sample consists of LIS classic papers. The papers contain highly cited papers of LIS that are introduced by Google Scholar. The research data have been gathered from Google Scholar, Scopus and Plum Analytics Categories. The data analysis has been done by Excel and SPSS applications.\u0000\u0000\u0000Findings\u0000The data indicate that among the highly cited articles of LIS, the highest score regarding the usage, captures, mentions and social media and the most abundance of citations belong to “Citation advantage of open access articles” and “Usage patterns of collaborative tagging systems.” Based on the results of Spearman statistical tests, there is a positive significant correlation between Google Scholar Citations and all studied indicators. However, only the correlation between Google Scholar Citations with capture metrics (p-value = 0.047) and citation metrics (p-value = 0.0001) was statistically significant.\u0000\u0000\u0000Originality/value\u0000Altmetrics indicators can be used as complement traditional indicators of Scientometrics to study the impact of papers. Therefore, the Altmetrics knowledge of LIS researchers and experts and practicing new studies in this field will be very important.\u0000","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":" ","pages":""},"PeriodicalIF":1.1,"publicationDate":"2019-02-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1108/PMM-10-2018-0025","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45471626","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Barriers and solutions to assessing digital library reuse: preliminary findings","authors":"Genya O’Gara, Liz Woolcott, E. J. Kelly, Caroline Muglia, Ayla Stein Kenfield, Santi Thompson","doi":"10.1108/PMM-03-2018-0012","DOIUrl":"https://doi.org/10.1108/PMM-03-2018-0012","url":null,"abstract":"\u0000Purpose\u0000The purpose of this paper is to highlight the initial top-level findings of a year-long comprehensive needs assessment, conducted with the digital library community, to reveal reuse assessment practices and requirements for digital assets held by cultural heritage and research organizations. The type of assessment examined is in contrast to traditional library analytics, and does not focus on access statistics, but rather on how users utilize and transform unique materials from digital collections.\u0000\u0000\u0000Design/methodology/approach\u0000This paper takes a variety of investigative approaches to explore the current landscape, and future needs, of digital library reuse assessment. This includes the development and analysis of pre- and post-study surveys, in-person and virtual focus group sessions, a literature review, and the incorporation of community and advisory board feedback.\u0000\u0000\u0000Findings\u0000The digital library community is searching for ways to better understand how materials are reused and repurposed. This paper shares the initial quantitative and qualitative analysis and results of a community needs assessment conducted in 2017 and 2018 that illuminates the current and hoped for landscape of digital library reuse assessment, its strengths, weaknesses and community applications.\u0000\u0000\u0000Originality/value\u0000In so far as the authors are aware, this is the first paper to examine with a broad lens the reuse assessment needs of the digital library community. The preliminary analysis and initial findings have not been previously published.\u0000","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":" ","pages":""},"PeriodicalIF":1.1,"publicationDate":"2018-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1108/PMM-03-2018-0012","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43492103","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A meta-analysis of service quality of Iranian university libraries based on the LibQUAL model","authors":"A. Ramezani, Seyed Javad Ghazimirsaeed, F. Azadeh, M. Bandboni, M. YektaKooshali","doi":"10.1108/PMM-05-2017-0014","DOIUrl":"https://doi.org/10.1108/PMM-05-2017-0014","url":null,"abstract":"\u0000Purpose\u0000The purpose of this paper is to assess the quality of Iranian university libraries.\u0000\u0000\u0000Design/methodology/approach\u0000This first systematic review and meta-analysis were based on the PRISMA guidelines by searching in national and international databases from 2003 to January 2017 with standard Persian and English keywords. Data searching, extracting and quality appraising were completed by two researchers, independently. Any unexpected documents were assessed by a third expert researcher. Data were extracted in accordance with the “Strength of the Reporting of Observational Studies in Epidemiology” checklist after the final selection of appraised documents. Random effects size based on Cochrane test and I2 were used for combining the obtained results from different studies together by considering the heterogeneity of studies.\u0000\u0000\u0000Findings\u0000Based on the meta-analysis conducted in 25 (6.42 percent) included studies, the total sample size was estimated. According to three dimensions of LibQUAL, findings of current information control, affect of service and the library as a place were estimated as 5.37 [CI95%: 5.02, 5.73], 6.91 [CI95%: 5.56, 6.26], and 5.46 percent [CI95%: 5.2, 5.73], respectively. Also, mean of service adequacy and superiority gap are equal to 0.07 [CI95%: −0.22, 0.36] and −2.06 [CI95%: −2.89, −1.23], respectively. There was a significant correlation between three dimensions of service quality and service superiority gap of LibQUAL and geographical regions of Iran (p<0.01). Also, a significant correlation was found between the gaps of services and three aspects of LibQUAL model and published years through a meta-regression test (p<0.01).\u0000\u0000\u0000Practical implications\u0000The results obtained from the present study showed that users are relatively satisfied with the quality of services provided by Iranian university libraries. An improvement in the quality of library services can promote the scientific level of universities.\u0000\u0000\u0000Originality/value\u0000The results of the present systematic review and meta-analysis study demonstrate a vital connection between primary research studies and decision-making for policymakers in Iranian university libraries to increase quality services.\u0000","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":" ","pages":""},"PeriodicalIF":1.1,"publicationDate":"2018-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1108/PMM-05-2017-0014","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49590568","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}