Performance Measurement and Metrics最新文献

{"title":"Adjusting the library performance standards for consortia services: a case study","authors":"Thalia Gonda, C. Papatheodorou","doi":"10.1108/pmm-04-2023-0010","DOIUrl":"https://doi.org/10.1108/pmm-04-2023-0010","url":null,"abstract":"PurposeThis study proposes a framework for performance measurement of library consortia services by implementing the indicators listed in ISO 11620. The framework is validated by using real data from HEAL-Link, the national consortium of Greek academic and research libraries to calculate the indicators.Design/methodology/approachThe paper reports on the related work regarding the services consortia offer to their members and the known methods and tools for assessing consortia services; the HEAL-Link case study, the aggregation and handling of data, is presented; ISO 11620 performance indicators for HEAL-Link services are calculated, and the results are discussed in terms of what was learnt- about the consortium, about measuring consortia services performance, and about the standard.FindingsISO 11620 could be used to measure performance for assessing consortia services. The performance indicators’ results reflect the two major events (mergers and COVID pandemic) that took place during the time of the study. ISO 11620 offers a basic insight that could be well complemented with other tools and standards.Originality/valueThe current study suggests that a widely accepted, easily applied, benchmarking ISO standard could be used to measure common consortia services’ performance, thus contributing to consortia assessment.","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2023-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43382425","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Measuring the value of online databases: a case study to validate an ROI model","authors":"A. Kaba, G. E. El Refae, S. Eletter, Tahira Yasmin","doi":"10.1108/pmm-09-2021-0047","DOIUrl":"https://doi.org/10.1108/pmm-09-2021-0047","url":null,"abstract":"PurposeThe return on investment (ROI) model is a tool used to measure the financial benefits and costs of an investment, in this case, the investment in digital library resources. By applying this model to the AAU digital library resources, the study seeks to determine whether these resources are providing sufficient value for the investment made in them.Design/methodology/approachThe proposed ROI model has two distinct phases and utilizes two different sets of data to calculate the return on investment for a database subscription. In Phase I, the ROI is calculated based on the total number of downloads of full-text articles from the database during the academic year 2019–2020. This information is used to determine the financial returns of the database subscription costs. In Phase II, the ROI is calculated by examining the citations drawn from the Scopus database on a sample of 30 funded research projects for the College of Engineering during the year 2019. These data are used to determine the impact of the database subscription on research output and its contribution to the success of the College of Engineering's research projects. The two phases of the proposed ROI model aim to provide a comprehensive understanding of the value of the database subscription and its impact on both financial returns and research output.FindingsThe findings of the study indicated different results between Phase 1 and Phase 2 of the study. The positive ROI in Phase 1 suggests that the investment in online databases has a good return for the AAU, as they are gaining almost a dollar for every dollar spent. However, the negative ROI in Phase 2 is concerning. It suggests that the investment in the IEEE database is not generating a positive return for the AAU and may even be costing the institution money. Overall, these findings highlight the importance of measuring ROI in academic libraries, particularly in Arab countries where resources may be limited. By understanding the impact of library investments on institutional outcomes, libraries can make informed decisions about where to allocate their resources and how to optimize their services to best serve their communities.Research limitations/implicationsThe findings of the current study were based on data collected from a specific sample, therefore, the findings may not be generalized to other academic libraries. A similar study with larger and more diverse samples can help to validate and extend the results of this study.Originality/valueThe findings of the study provide evidence that the proposed ROI model can be effectively applied in Arab countries and academic libraries in the Arab world, this could encourage more institutions in the region to adopt this model for evaluating their investments and projects. The study may also guide how to adapt the model to the specific cultural and organizational contexts of Arab countries.","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2023-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47852364","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Valid questions: the development and evaluation of a new library learning analytics survey","authors":"Andrew D. Asher, Kristin A. Briney, Abigail H. Goben","doi":"10.1108/pmm-04-2023-0009","DOIUrl":"https://doi.org/10.1108/pmm-04-2023-0009","url":null,"abstract":"PurposeThis article describes the development processes, sampling and analysis practices and the assessment of reliability and validity of a new 0survey that sought to evaluate undergraduate students' perceptions and expectations related to privacy and library participation in learning analytics studies. This article provides other researchers with information required to independently evaluate the survey's efficacy, as well as guidance for designing other surveys.Design/methodology/approachFollowing question development, pre-survey validity assessments were made using subject matter expert panel review and cognitive interviews. Post-hoc analysis of survey construct reliability was evaluated using the Omega coefficient, while exploratory factor analysis was utilized to assess construct validity. Survey design limitations and potential bias effects are also examined.FindingsThe survey exhibited a high level of reliability among research constructs, while the exploratory factor analysis results suggested that survey constructs contained multiple conceptual elements that should be measured separately for more nuanced analysis.Practical implicationsThis article provides a model for other researchers wishing to re-use the survey described or develop similar surveys.Social implicationsAs learning analytics interest continues to expand, engaging with the subjects, in this case students, of analysis is critical. Researchers need to ensure that captured measurements are appropriately valid in order to accurately represent the findings.Originality/valueThis survey is one of very few addressing library learning analytics that has undergone extensive validity analysis of the conceptual constructs.","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2023-07-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45679019","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Analyzing Persian Wikipedia's citations to discover the effectiveness of Persian scientific papers: applied web mining techniques","authors":"F. Rahimi, F. Danesh","doi":"10.1108/pmm-07-2022-0021","DOIUrl":"https://doi.org/10.1108/pmm-07-2022-0021","url":null,"abstract":"PurposeThe main objective of this study is to evaluate the impact of Persian Scientific Papers (PSPs) on Persian Wikipedia by studying Wikipedia's citations to these papers.Design/methodology/approachThe present study is applied research, which has been performed by the web-mining method, such as downloading web pages, extracting information (references), identifying papers, detecting peer-review journals and calculating the frequency rates. The statistical population included 10,000 Persian Wikipedia Pages (PWPs) that were analyzed in two rounds with a six-month interval.FindingsThe number of pages containing the Persian references section was 3,994 and 4,063 out of the 10,000 pages extracted in the first and second rounds. The ratio of pages that cited scientific sources (58 and 67 pages) to the pages extracted from the PWP was equal to 0.58 and 0.67%. The ratio of pages that cited scientific sources to pages with Persian references in each round was equal to 1.45 and 1.64%. The number of references extracted from the PWP in each round equaled 30,441 and 35,891. Eight titles from reputable Persian journals had received at least three citations from Wikipedia.Originality/valueThe present study has determined the extent of interaction between science and society (knowledge flow) in the form of citations from Wikipedia articles to articles in peer-reviewed journals. The study of this issue in Persian Wikipedia in more than 2000 Persian peer-reviewed journals shows the originality of the present paper. Studying citation reliability in a collaborative and openly editable platform is another originality of the work.","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2023-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45422660","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Assessing information quality of Bangladesh e-government websites","authors":"Md. Hasinul Elahi, S. M. Zabed Ahmed","doi":"10.1108/pmm-04-2021-0017","DOIUrl":"https://doi.org/10.1108/pmm-04-2021-0017","url":null,"abstract":"PurposeThe purpose of this paper is to assess the information quality of e-government websites by university-education citizens of Bangladesh. It also investigated citizens' demographic and Internet related variables associated with perceived information quality ratings and the validity of the underlying factor structure of information quality dimensions.Design/methodology/approachAn online survey was conducted to assess information quality of e-government websites among a sample of university-educated citizens in Bangladesh. Descriptive statistics were obtained to examine respondents' ratings on information quality of these websites on a five-point Likert scale. A multiple linear regression model was applied to determine the effect of demographic and Internet use variables associated with information quality ratings on e-government websites. Finally, a confirmatory factor analysis (CFA) was performed to determine the underlying factor structure of information quality dimensions.FindingsThe findings revealed that the ratings on most information quality items were close to 4.00 on a five-point scale, indicating a generally high information quality of Bangladesh e-government websites. Out of 20 information quality dimensions, value-added and authority were the two top-rated information quality dimensions while security, completeness, reliability, advertisement, relevance and ease of use were the least rated dimensions. The results of multiple regression suggested that gender, age and the device used for accessing the Internet were significantly associated with information quality of e-government websites. The CFA results indicated that information quality dimensions corroborate the factor structure of information quality dimensions used in earlier studies, although the model fit statistics were not fully validated.Research limitations/implicationsThe focus of this study was confined to university-educated citizens in Bangladesh. Therefore, the results of this study may not be generalized to other demographic groups in Bangladesh or elsewhere.Practical implicationsThis paper can provide guidelines for developing high-quality, informative and citizen-centric e-government websites and suggest ways on how these websites can be evaluated for information quality.Originality/valueThis study is the first to examine the information quality of e-government websites from the citizens' perspective in Bangladesh. The findings of this paper can assist responsible government agencies in making the websites more informative and useful for a diverse group of users.","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2023-06-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46950748","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The users' expectations of library service quality in the college libraries of Pakistan: a LibQUAL study","authors":"K. Mahmood, S. Rehman, M. Ashiq","doi":"10.1108/pmm-02-2020-0009","DOIUrl":"https://doi.org/10.1108/pmm-02-2020-0009","url":null,"abstract":"PurposeThis research study is conducted to thoroughly investigate the users' expectations for excellent library service quality (LSQ) from college libraries. It will also identify whether there is any difference in the desired library service quality among different type of users, gender and academic discipline.Design/methodology/approachA survey method was used, and the data were collected from 998 respondents, which included faculty members, masters, bachelor's and intermediate students. In order to conduct the study, LibQUAL + instrument were adapted.FindingsThe results demonstrated that the users expected a higher level of services from the college libraries of Pakistan. The highest desired expectation of the users were related to “library as a place (LP)” dimension, while the lowest expectation was with regards to the “information control (IC)” dimension. The results indicated a significant difference among the various types of users and academic disciplines regarding their expectations with library services.Practical implicationsThe appointment of college librarians against nearly 500 vacant posts would significantly improve the LSQ in these libraries. The result of the study would indeed be useful for the college administration, librarians the Government of the Punjab and the Punjab Higher Education Commission (HEC) for future planning, improvement of services and allocation of resources.Originality/valueThis study is the first in-depth effort into investigating the LSQ of the college libraries of the Punjab, Pakistan. This study will be helpful to understand the LSQ from developing countries’ perspective.","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2023-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49321992","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Print vs. electronic resources: influence of demographical characteristics of undergraduates on preferences and choices under diverse circumstances","authors":"Nirupma Chohda, Shiv Kumar","doi":"10.1108/pmm-05-2022-0016","DOIUrl":"https://doi.org/10.1108/pmm-05-2022-0016","url":null,"abstract":"PurposeThis paper delineates the appraising and comparing the circumstances that may influence the choices and preferences of the undergraduates of National Institutes of Technology (NITs) of the north-western region of India for using library’s print versus electronic resources. The author investigated the circumstances in knowing whether different situations impact their choice for using print or electronic resources concerning their demographical characteristics for their academic learning.Design/methodology/approachThe study used a survey of undergraduates at six NITs in the north-western region of India. The responses were analysed using Chi-Square, Mann–Whitney and Kruskal–Wallis statistical analysis tests, via SPSS software.FindingsThe study revealed that respondents preferred a mix of both forms of sources for their academic studies under different circumstances. The results reveal that the institution of respondents affected the choice of print resources over e-resources and vice versa in many different circumstances. Respondents’ year of study affected the choice of using print over e-resources and vice versa in certain situations. The residential backdrop affects the choice of using e-resources over print in some situations. Gender of respondents affects the choice of using e-resources over print under some situations.Practical implicationsThe study will further aid librarians at six NITs in the north-western region of India to know whether print resources still have the same importance among library users or their preference switched towards using electronic resources.Originality/valueThis study offers new perspectives on the use of print verses electronic resources among the undergraduates at six NITs in the north-western region of India so that the libraries can procure desired resources rather than moving with the market trends.","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2023-01-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48167979","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"An assessment of selection and acquisition practices in meeting library users' information needs at Kenyan National Museum Library","authors":"Kaltuma Sama Bonaya","doi":"10.1108/pmm-04-2021-0015","DOIUrl":"https://doi.org/10.1108/pmm-04-2021-0015","url":null,"abstract":"PurposeThe purpose of this paper is to show how quality information materials are maintained in Kenyan museum libraries by examining collection development policy, skills and processes used by librarians in acquisition.Design/methodology/approachA total of 137 respondents, which included 130 registered library users and seven members of staff, completed the questionnaires. This included the principal librarian, for whom an interview schedule was used to collect the required data. A pilot study to ensure data validity and reliability was carried out at the Kenya Medical Research Institute Library. Statistical Packages for Social Science (SPSS) was used to analyze the research data.FindingsThe findings, which were presented both textually and graphically, show that the National Museum of Kenya library lacks a collection development policy to guide the acquisition process, as well as a diverse set of information resources that are both comprehensive and current to meet the current user information needs. Furthermore, the key impediment to the acquisition of information materials was revealed to be financial constraints, and there was a positive effort to involve library users in the acquisition process.Research limitations/implicationsThe study focus on library users and library staff at the National Museums of Kenya (NMK) library in Nairobi, it may not be, therefore, representative of the acquisition processes at all Kenyan museum libraries. Although NMK has other branches across the country, they were not included in this study.Practical implicationsThis paper purposes to provide the Kenyan museum library with important information about maintaining quality information materials from the perspectives of librarians and library users. Despite efforts to improve information materials, the management faces financial challenges.Social implicationsThe study unveils underlying picture in selection and acquisition practices which will inform on meeting library users information needs.Originality/valueThe paper is of value as a case study of Kenya Museums Library.","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2022-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49606536","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Impact of service quality on user satisfaction in public university libraries of Bangladesh using structural equation modeling","authors":"Md.Jahangir Alam, M. Mezbah-ul-Islam","doi":"10.1108/pmm-06-2021-0033","DOIUrl":"https://doi.org/10.1108/pmm-06-2021-0033","url":null,"abstract":"PurposeThe study aims to appraise the impact of service quality dimensions on user satisfaction in Bangladeshi public university libraries using structural equation modeling (SEM).Design/methodology/approachThis study developed an SEM method based on SERVQUAL, LibQUAL+ and SERVPERF instruments, including 30 items under five service quality dimensions and eight satisfaction items with the 7-point Likert scale to appraise the impact of library service quality dimensions on user satisfaction. For this purpose, a survey was carried out among 437 students, 52 MPhil/PhD researchers and 32 teachers of the nine selected public university libraries of Bangladesh through a structured questionnaire. The SEM approach included path analysis, confirmatory and exploratory factor analysis, as well as construct reliability and validity where user satisfaction was used as the dependent variable, and five service quality dimensions were applied as independent variables.FindingsThis model was identified as significant and clarified 58% of the total variation in user satisfaction. The study findings indicated that resources of the libraries, staff competence, demeanor approach and tangible facilities of the public university libraries have a significant impact on user satisfaction.Originality/valueAn initiative has been taken for the first time to ascertain the impact of library service quality on user satisfaction applying the SEM approach in Bangladesh. Moreover, it creates an avenue to prompt future studies on the structural relationship between user satisfaction and service quality dimensions in academic libraries globally.","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2022-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42056002","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Investigating the impact of usage factors on satisfaction and intention to use e-resources","authors":"Vandana, R. Garg, Vinod Kumar, A. Singh","doi":"10.1108/pmm-08-2021-0042","DOIUrl":"https://doi.org/10.1108/pmm-08-2021-0042","url":null,"abstract":"PurposePresent research analyzes and evaluates the impact of e-resources usage factors (training modes, awareness, influencers, utilitarian benefits and ease of use) towards satisfaction and intention to use these e-resources.Design/methodology/approachThe data for present study were collected from postgraduate students of Delhi (India) and 248 valid responses were received through the survey. After reliability and validity tests, structural relationships between variables were studied.FindingsThe present study revealed that all five factors significantly affected satisfaction and intention to use e-resources. However, influencers were found to have the highest impact on satisfaction and intention to use e-resources.Originality/valueThe present study is a maiden attempt to explore the impact of e-resources usage factors on satisfaction and intention to use by postgraduate students at management schools in Delhi, India.","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2022-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42618333","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}