Performance Measurement and Metrics最新文献

{"title":"Articulating value and impact through outcome-centered service delivery: The student and learning support experience at the University of Sunderland","authors":"Kay Grieves, O. Pritchard","doi":"10.1108/PMM-08-2017-0034","DOIUrl":"https://doi.org/10.1108/PMM-08-2017-0034","url":null,"abstract":"Purpose \u0000 \u0000 \u0000 \u0000 \u0000The purpose of this paper is to share the ways in which student and learning support at the University of Sunderland has embedded and matured a new outcome-centered performance model – the Quality Model – in order to create an agile evidence-base of value, outcome and impact evidence. The authors will also share how, having established the fundamental principles regarding value and impact capture in our library setting, the concepts and approaches have also been developed and applied successfully within the context of multi-converged service delivery across the wider student and learning support service, using the AMOSSHE Value and Impact Toolkit. \u0000 \u0000 \u0000 \u0000 \u0000Design/methodology/approach \u0000 \u0000 \u0000 \u0000 \u0000The authors’ approach will be illustrated with two case studies, the first focusing on the university library services and the second on the student counseling service. \u0000 \u0000 \u0000 \u0000 \u0000Findings \u0000 \u0000 \u0000 \u0000 \u0000The findings will reveal that by establishing an outcome-focused model, the authors have been able to apply it across a converged service in order to generate the evidence required to articulate the value and impact of our key service objectives. \u0000 \u0000 \u0000 \u0000 \u0000Originality/value \u0000 \u0000 \u0000 \u0000 \u0000As a performance approach, the Quality Model is an original concept in that it is a self-formed model designed to meet the strategic needs of the University of Sunderland. It differs from many performance models in that it is founded on a holistic approach to service culture and customer-relationship management and is based upon strategic marketing principles. The AMOSSHE Toolkit is a pre-existing toolkit which is fully referenced in the paper. The Quality Model and AMOSSHE Toolkit are of particular relevance as many higher education services are increasingly challenged to demonstrate their value and impact and the outcomes their services deliver. This calls for a strategic approach to managing qualitative evidence. Therefore, although bespoke, the approach is transferable to the strategic priorities of other HE settings.","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2017-12-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1108/PMM-08-2017-0034","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44788727","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The Curtin Materials Availability Survey 2017","authors":"David Wells","doi":"10.1108/PMM-10-2017-0046","DOIUrl":"https://doi.org/10.1108/PMM-10-2017-0046","url":null,"abstract":"Purpose The research extends the principles of earlier print-based availability surveys to the context of today’s electronic library, and explores the question of an appropriate methodology. The ability of clients to find what they want remains a central question, as does the library’s ability to identify and address the reasons that clients fail to find what they are looking for. Design/methodology/approach Catalogue users at Curtin University Library were invited to complete an online survey indicating whether they had found the electronic item they were looking for, and if not to nominate the reason why. Responses were then verified and analysed by library staff. Findings The survey attracted a low number of usable responses, though the proportion of respondents who stated they were able to find what they were looking for was consistent with the findings of earlier studies. It was possible to identify a small number of cases were the library did not hold the item required, though most failures were eit...","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2017-12-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1108/PMM-10-2017-0046","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43915822","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Understanding students’ satisfaction with OERs as course materials","authors":"S. Jaggars, A. Folk, D. Mullins","doi":"10.1108/PMM-12-2017-0059","DOIUrl":"https://doi.org/10.1108/PMM-12-2017-0059","url":null,"abstract":"Purpose \u0000 \u0000 \u0000 \u0000 \u0000The purpose of this paper is to introduce a survey instrument to measure three components of students’ perceptions of open and affordable course materials – quality, integration, and experience – and discuss its reliability and predictive validity. \u0000 \u0000 \u0000 \u0000 \u0000Design/methodology/approach \u0000 \u0000 \u0000 \u0000 \u0000The authors distributed an end-of-semester online survey to students enrolled in sections of 12 courses that adopted OER in Fall 2016, as well as conducting a within-interview survey with the instructors of those courses. The authors calculated the descriptive statistics from the responses to the student survey, as well as examining the inter-item and inter-rater reliability of the instrument. Finally, explored correlations in the data gathered through both the student and faculty surveys were explored. \u0000 \u0000 \u0000 \u0000 \u0000Findings \u0000 \u0000 \u0000 \u0000 \u0000The authors found that both students and faculty were generally pleased with the quality and experience of using open and affordable digital materials. The authors also found that our three survey subscales had strong inter-item reliability, and that the quality and experience subscales had predictive validity in terms of whether students would choose a traditional or digital text in future courses. \u0000 \u0000 \u0000 \u0000 \u0000Originality/value \u0000 \u0000 \u0000 \u0000 \u0000In addition to providing evidence in terms of the full survey instrument’s reliability and predictive validity, factor analysis indicates that a short scale of quality and experience Likert scale items could be used by practitioners to effectively assess satisfaction of digital materials among traditionally aged undergraduate students.","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2017-12-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1108/PMM-12-2017-0059","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42479014","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Contextualizing library assessment within a broader ecosystem: Proposed models for linking the strategic to the micro","authors":"Christine McCarthy Madsen, M. Hurst","doi":"10.1108/PMM-09-2017-0042","DOIUrl":"https://doi.org/10.1108/PMM-09-2017-0042","url":null,"abstract":"Purpose This paper will draw a picture of the current landscape of library assessment based on the data gathered in interviews. The authors will focus specifically on the continuum between micro and strategic assessment and share the lessons learned from diverse institutions and geographies about how to build a culture of assessment. Design/methodology/approach Between 2015 and 2017, the researchers have interviewed more than 75 library directors and leaders, library assessment practitioners, and academic experts on four continents about library assessment and its current state in their institutions. Findings The results reveal a varied landscape, with libraries in widely varying stages of assessment performance and readiness. Originality/value This paper presents the results of a large-scale study over more than two years. More than 75 people have been interviewed in five countries. The scale and scope of the work is both significant and unique.","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2017-12-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1108/PMM-09-2017-0042","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47177484","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Generating bespoke value and impact evidence to inform a thought leadership approach to service engagement at The University of Sunderland","authors":"Kay Grieves","doi":"10.1108/PMM-09-2017-0041","DOIUrl":"https://doi.org/10.1108/PMM-09-2017-0041","url":null,"abstract":"Purpose In this paper we will share how our maturing value and impact model at The University of Sunderland is enabling us to generate evidence and articulate the insights we draw from that evidence to inform and underpin our strategic service planning, resourcing and reporting. Design/methodology/approach We will demonstrate how impactful articulation of these insights through data-visualization is enabling us to employ thought-leadership in our relationship management with stakeholders, by increasing their understanding of the benefit of engagement with our service offers and demonstrating value for money and the value and impact of our role in achieve institutional objectives. Our paper will give an overview of the key techniques of our model and will then demonstrate its practical applications using the following examples: • How our model is underpinning our approaches to thought leadership in relationship management by enabling us to effectively generate and articulate evidence to inform strategic fa...","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2017-12-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1108/PMM-09-2017-0041","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44801343","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The use of academic libraries in turbulent times: Student library behaviour and academic performance at the University of Cape Town","authors":"K. D. Jager, M. Nassimbeni, W. Daniels, A. D'Angelo","doi":"10.1108/PMM-09-2017-0037","DOIUrl":"https://doi.org/10.1108/PMM-09-2017-0037","url":null,"abstract":"Purpose \u0000 \u0000 \u0000 \u0000 \u0000The purpose of this paper is to explore how an innovation in the University Management Information System was leveraged to incorporate library data by an initially sceptical strategic management team. The rationale was to extract evidence of correlations between library use and student achievement. This kind of information is of particular interest to the institution, which is at present dealing with crises popularly summarised in the slogan “#FeesMustFall” among students who suffer from the effects of poverty and exclusion in higher education. Comment is offered on some of the relationships between student library behaviour before, during and after the nationwide disruptions that destabilised universities and threatened their survival at the end of 2016, just before the final examination period. \u0000 \u0000 \u0000 \u0000 \u0000Design/methodology/approach \u0000 \u0000 \u0000 \u0000 \u0000Data were extracted from the data warehouse from the comparative demographic perspectives of students’ degrees of disadvantage in an effort to uncover any hitherto hidden patterns of library use. \u0000 \u0000 \u0000 \u0000 \u0000Findings \u0000 \u0000 \u0000 \u0000 \u0000The use of the library as expressed by footfall and loans was mapped against students’ pass rates and their collective GPA, indicating that increased library use correlates positively with better academic performance. Some of the initial correlations between student library behaviour before, during and after the nationwide disruptions that destabilised universities and threatened their survival at the end of 2016 just before the final examination period are explored. The effects that library closures (under threat of damage) at a critical time in the academic year might have had on library use and on student performance are interrogated. \u0000 \u0000 \u0000 \u0000 \u0000Practical implications \u0000 \u0000 \u0000 \u0000 \u0000Students on financial aid, which was used as an indicator of disadvantage, come from schools and environments where access to information technology and libraries is very limited, so that library habits are either poorly established or not at all. At the University of Cape Town (UCT), considerable support is in place for students to encourage the development of library habits. An analysis of available data indicates that students who have acquired library habits regardless of unfavourable financial circumstances do not exhibit behaviour and academic outcomes markedly different from that of their more privileged peers. \u0000 \u0000 \u0000 \u0000 \u0000Originality/value \u0000 \u0000 \u0000 \u0000 \u0000Combining library data with data from the university data warehouse is a new approach in South Africa. It is an approach that is of value both to the library and the institution at large and has brought meaningful insights into the role the academic library might be seen to play in promoting student academic achievement.","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2017-12-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1108/PMM-09-2017-0037","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48029275","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Experience assessment: designing an innovative curriculum for assessment and UX professionals","authors":"Rachel A. Fleming-May, Regina Mays, T. Walker, Amy Forrester, C. Tenopir, Dania Bilal, Suzie L. Allard","doi":"10.1108/PMM-09-2017-0036","DOIUrl":"https://doi.org/10.1108/PMM-09-2017-0036","url":null,"abstract":"Purpose \u0000 \u0000 \u0000 \u0000 \u0000While assessment and user experience (UX) have been identified as areas of growing focus in all types of libraries, there is currently little infrastructure to prepare students for these roles (Applegate, 2016; Askew and Theodore-Shusta, 2013; Nitecki et al., 2015; Oakleaf, 2013; Passonneau and Erickson, 2014). As a step toward addressing this gap, a team from an American Library Association-accredited master’s program situated at a large public land-grant institution (LGU) worked with practitioner partners from academic libraries and information agencies to develop a new model for preparing information professionals with assessment and UX expertise. The paper aims to discuss these issues. \u0000 \u0000 \u0000 \u0000 \u0000Design/methodology/approach \u0000 \u0000 \u0000 \u0000 \u0000In fall of 2015, faculty members applied for funding from the US Institute for Museum and Library Services Laura Bush 21st Century Librarians program for a program to develop formalized assessment and UX training in Library and Information Science (LIS) education. The student cohort would have interests in two areas: academic libraries and specialized information agencies. The two groups would complete much of the same coursework, earn the ALA-accredited master’s degree and have the opportunity to engage in co-curricular activities focused on UX and assessment. However, each sub-group would also pursue a subject-specific curriculum. In April 2016, IMLS funded the program. \u0000 \u0000 \u0000 \u0000 \u0000Findings \u0000 \u0000 \u0000 \u0000 \u0000In addition to reviewing the literature related to best practices in curriculum development, the authors describe the process of designing the program, including the curriculum, co-curricular mentoring and practicum opportunities, and the tools developed to evaluate the program’s effectiveness. \u0000 \u0000 \u0000 \u0000 \u0000Research limitations/implications \u0000 \u0000 \u0000 \u0000 \u0000At a time in which the library practitioner and LIS educator communities are contemplating how best to prepare professionals with much-needed expertise in assessment and UX, UX-A represents an innovative approach in professional preparation. Although the UX-A program is grant-funded, several of the program components could be adapted and incorporated without such support. \u0000 \u0000 \u0000 \u0000 \u0000Originality/value \u0000 \u0000 \u0000 \u0000 \u0000This paper discusses the structure and history of the program, issues related to developing a new curricular program for LIS education, and the educational and professional development needs of the assessment and UX professional community. It includes an extensive review of literature related to LIS curriculum development, practica, and professional mentoring, as well as suggestions for implementing elements of the program in other settings.","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2017-12-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1108/PMM-09-2017-0036","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46894248","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"COUNTER: Release 5 of the Code of Practice","authors":"Lorraine Estelle","doi":"10.1108/PMM-10-2017-0048","DOIUrl":"https://doi.org/10.1108/PMM-10-2017-0048","url":null,"abstract":"Purpose \u0000 \u0000 \u0000 \u0000 \u0000Librarians need to measure returns on the investments that they make, and for digital content, the COUNTER Code of Practice for usage statistics is an important metric. The paper aims to discuss these issues. \u0000 \u0000 \u0000 \u0000 \u0000Design/methodology/approach \u0000 \u0000 \u0000 \u0000 \u0000This paper is a viewpoint. \u0000 \u0000 \u0000 \u0000 \u0000Findings \u0000 \u0000 \u0000 \u0000 \u0000Release 5 of the Code of Practice has been developed to make it easier for publishers to be compliant. It can be adapted and extended as digital publishing changes over the years. \u0000 \u0000 \u0000 \u0000 \u0000Originality/value \u0000 \u0000 \u0000 \u0000 \u0000Release 5 consists of four master reports, a reduced number of metrics and additional attributes. These will enable librarians to roll up or drill down through reports with ease, eliminating the need for the kinds of special-purpose reports required previously.","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2017-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1108/PMM-10-2017-0048","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45068931","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The psychometric properties of an information-ethics questionnaire","authors":"M. Al-Nuaimi, Abdelmajid Bouazza, Maher M. Abu-Hilal, A. Al-Aufi","doi":"10.1108/PMM-10-2016-0044","DOIUrl":"https://doi.org/10.1108/PMM-10-2016-0044","url":null,"abstract":"Purpose \u0000 \u0000 \u0000 \u0000 \u0000The purpose of this paper is to provide an overview of the development and validation of a self-report structured questionnaire based on the theory of planned behaviour (TPB). The questionnaire was used to investigate university undergraduate students’ cognition, behavioural intent, and behaviour concerning the ethical use of information and communication technologies (ICTs). \u0000 \u0000 \u0000 \u0000 \u0000Design/methodology/approach \u0000 \u0000 \u0000 \u0000 \u0000A quantitative correlational cross-sectional approach to data collection was used by administering a self-report questionnaire to a sample of 327 undergraduate students. To establish the construct validity of the questionnaire, internal consistency reliability and factorial analyses were performed. \u0000 \u0000 \u0000 \u0000 \u0000Findings \u0000 \u0000 \u0000 \u0000 \u0000Significant but different correlations between the constructs were under study. The behavioural intention had the greatest and most significant correlation with behaviour pertaining to information ethics. Overall, the scales, which constitute the instrument, showed acceptable indices of measurement validity. \u0000 \u0000 \u0000 \u0000 \u0000Practical implications \u0000 \u0000 \u0000 \u0000 \u0000The research implications of this paper shed light on the applicability of the TPB to the specific context in which this study was conducted. The results imply that the TPB framework can be extended and employed to understand better the influence of comprehending information-ethics concepts on the intentions and practices related to the ethical use of ICTs. \u0000 \u0000 \u0000 \u0000 \u0000Originality/value \u0000 \u0000 \u0000 \u0000 \u0000The paper has methodological value for researchers who seek to develop empirical instruments for measuring the factors that bear upon the attitudes and the behaviours related to information ethics. Furthermore, the paper has pedagogical value for students, teachers, and developers of information-ethics educational programmes at the tertiary level.","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2017-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1108/PMM-10-2016-0044","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43680101","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Relationship between Journal Ranking Metrics in a Diversified Collection","authors":"Upeksha Perera, Manjula Wijewickrema","doi":"10.1108/PMM-10-2016-0042","DOIUrl":"https://doi.org/10.1108/PMM-10-2016-0042","url":null,"abstract":"Purpose \u0000 \u0000 \u0000 \u0000 \u0000Ranking of scholarly journals is important for many parties owing to numerous reasons. Studying the relationships among various ranking metrics is the key to understand the performance of one metric based on another. Therefore, the aim of this research is to investigate the relationship among four major journal ranking methods, namely: Impact Factor (IF), Eigenfactor Score (ES), h-index (hI), and SCImagoJournal Rank (SJR). \u0000 \u0000 \u0000 \u0000 \u0000Design/methodology/approach \u0000 \u0000 \u0000 \u0000 \u0000The paper investigates 519 journals from a diverse range of subjects to execute a comprehensive correlation analysis. \u0000 \u0000 \u0000 \u0000 \u0000Findings \u0000 \u0000 \u0000 \u0000 \u0000The results show that there exists a higher correlation between the IF and SJR (0.796). However, a very strong positive correlation among two metrics does not necessarily imply that the journals are ranked in the similar pattern. \u0000 \u0000 \u0000 \u0000 \u0000Originality/value \u0000 \u0000 \u0000 \u0000 \u0000The first study which discusses the journal ranking relationships in a diversified collection and the inability of comparing correlations between metric values and the correlations between corresponding journal ranks.","PeriodicalId":44583,"journal":{"name":"Performance Measurement and Metrics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2017-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44838670","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}