Evaluation Journal of Australasia最新文献_第4页

Evaluation Journal of Australasia Pub Date : 2022-08-22 DOI: 10.1177/1035719X221121400

Lyn Alderman

引用次数: 0

Editorial 编辑

Evaluation Journal of Australasia Pub Date : 2022-08-22 DOI: 10.1177/1035719X221121399

M. Forbes

引用次数: 0

Course enhancement conversations: A holistic and collaborative evaluation approach to quality improvement in higher education 课程改进对话：提高高等教育质量的整体合作评估方法

Evaluation Journal of Australasia Pub Date : 2022-08-11 DOI: 10.1177/1035719X221120295

Melissa Forbes, A. Murphy, Lyn Alderman

{"title":"Course enhancement conversations: A holistic and collaborative evaluation approach to quality improvement in higher education","authors":"Melissa Forbes, A. Murphy, Lyn Alderman","doi":"10.1177/1035719X221120295","DOIUrl":"https://doi.org/10.1177/1035719X221120295","url":null,"abstract":"This practice article describes the use of collaborative evaluation for institutional improvement leading to continuous learning at a regional university in Australia. The University of Southern Queensland’s Academic Quality Framework (2019–2022) was developed in response to external drivers to improve practices relating to the comprehensive and systematic analysis of academic data. One aspect of the response was to introduce ‘course enhancement conversations’, which were a collaboration between the central Academic Quality Unit and academic staff, including course teams and learning and teaching leaders within schools and faculties. A feature of these conversations was the use of sentinel rather than performance indicators of course (not teaching) quality to prompt the holding of conversations. Conversations were conducted in a spirit of constructive collaboration, where the shared goal was to support course teams to deliver an outstanding student experience. Through adopting a collaborative approach to evaluation, Academic Quality Unit staff were evaluation champions who gradually acculturated academic staff and learning and teaching leaders to evaluative thinking and data-informed decision-making. Issues brought to light during these conversations have informed changes in practice at the university level, including the development of a new evaluation procedure to embed best-practice monitoring and evaluation across all levels of curriculum delivery.","PeriodicalId":37231,"journal":{"name":"Evaluation Journal of Australasia","volume":"22 1","pages":"221 - 236"},"PeriodicalIF":0.0,"publicationDate":"2022-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45929418","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

Design roadmapping: Guidebook for future foresight techniques 设计路线图:未来预见技术指南

Evaluation Journal of Australasia Pub Date : 2022-08-10 DOI: 10.1177/1035719X221120296

Emily Montgomery

引用次数: 5

Critical appraisal of the establishment of a theory-informed evaluation capacity building function in a large government department 批判性评价在大型政府部门中建立了理论指导的评价能力建设功能

Evaluation Journal of Australasia Pub Date : 2022-06-21 DOI: 10.1177/1035719X221109311

D. Lloyd, Eleanor B. Williams, Desiree Terrill

{"title":"Critical appraisal of the establishment of a theory-informed evaluation capacity building function in a large government department","authors":"D. Lloyd, Eleanor B. Williams, Desiree Terrill","doi":"10.1177/1035719X221109311","DOIUrl":"https://doi.org/10.1177/1035719X221109311","url":null,"abstract":"Evaluation Capacity Building (ECB) is a critical function that can increase uptake, quality and impact of evaluation activity in large organisations. This article describes how ECB theory has been applied in the design and implementation of foundational evaluation training in a large state government department. Appraisal of the first three years (2018–21) establishing the training component of the capacity building function is explored, in light of contemporary capacity building literature. Post-training feedback indicated high degree of participant satisfaction and met need among department staff. One-year follow-up of training workshops indicated that over two-thirds of respondents (68 percent) found evaluation training had a lasting impact on their work, and that participants continued to use evaluation support materials and apply what they had learned. The article provides practical information on this theory-informed approach, to support others who are commencing or delivering evaluation capacity initiatives within public sector agencies or other large organisations, including for those who are adapting training for online delivery during COVID-19. The article identifies lessons learned, including through the experience of moving training online during the COVID-19 pandemic, and presents opportunities to increase the impact of evaluation capacity building.","PeriodicalId":37231,"journal":{"name":"Evaluation Journal of Australasia","volume":"22 1","pages":"142 - 156"},"PeriodicalIF":0.0,"publicationDate":"2022-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43205287","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Lessons learned in evaluating system interdependencies using qualitative methods. 使用定性方法评估系统相互依存性的经验教训。

Evaluation Journal of Australasia Pub Date : 2022-06-01 Epub Date: 2022-02-14 DOI: 10.1177/1035719x211066961

Eric Souvannasacd, Heather Engblom, Richard N Van Eck, Ralph Renger, Marc Basson

引用次数: 0

Evaluating a peer-led wellbeing programme for doctors-in-training during the COVID-19 pandemic in Victoria, Australia, using the Most Significant Change technique. 使用最显著变化技术评估澳大利亚维多利亚州新冠肺炎大流行期间接受培训的医生的同行健康计划

Evaluation Journal of Australasia Pub Date : 2022-06-01 DOI: 10.1177/1035719X221080576

Karen Crinall, Madeleine Ward, Rebecca McDonald, William Crinall, James Aridas, Daniel L Rolnik

{"title":"Evaluating a peer-led wellbeing programme for doctors-in-training during the COVID-19 pandemic in Victoria, Australia, using the Most Significant Change technique.","authors":"Karen Crinall, Madeleine Ward, Rebecca McDonald, William Crinall, James Aridas, Daniel L Rolnik","doi":"10.1177/1035719X221080576","DOIUrl":"10.1177/1035719X221080576","url":null,"abstract":"<p><p>This article discusses the use of the Most Significant Change (MSC) technique in a mixed-methods evaluation of a pilot wellbeing programme for obstetrics and gynaecology doctors-in-training introduced at a large public hospital during Melbourne, Australia's second coronavirus (COVID-19) lockdown, which occurred from 7 July to 26 October 2020. The evaluation was conducted remotely using videoconferencing technology, to conform with pandemic restrictions. MSC complemented the program's participatory principles and was chosen because it seeks to learn about participants' perceptions of programme impacts by evaluating their stories of significant change. Stakeholders select one story exemplifying the most significant change resulting from the evaluated program. Inductive thematic analysis of all stories is combined with reasons for making the selection, to inform learnings (Dart & Davies, 2003; Tonkin et al., 2021). Nine stories of change were included in the selection. The most significant change was a more supportive workplace culture brought about by enabling basic needs to be met and breaking down hierarchical barriers. This was linked to five interconnected themes - connection, caring, communication, confidence and cooperation. The evaluation learnings are explored and reflections on remotely conducting MSC evaluation are shared.</p>","PeriodicalId":37231,"journal":{"name":"Evaluation Journal of Australasia","volume":"22 1","pages":"90-107"},"PeriodicalIF":0.0,"publicationDate":"2022-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8961201/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46990821","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Suicide story: An evaluation of ‘tackling suicide Our Way’ 自杀故事:对“以我们的方式处理自杀”的评价

Evaluation Journal of Australasia Pub Date : 2022-05-23 DOI: 10.1177/1035719X221104841

J. Guenther, M. Roberts, Keith Buzzacott, Danielle Dyall

{"title":"Suicide story: An evaluation of ‘tackling suicide Our Way’","authors":"J. Guenther, M. Roberts, Keith Buzzacott, Danielle Dyall","doi":"10.1177/1035719X221104841","DOIUrl":"https://doi.org/10.1177/1035719X221104841","url":null,"abstract":"Despite concerted efforts to improve strategic responses to suicide, it remains a major concern in Australia. Among Indigenous communities the rates of suicide are up to three times higher than among non-Indigenous communities. Indigenous males are three times as likely to suicide than Indigenous females. The death rates for the Northern Territory are second highest in Australia, at 27.4 deaths per 100,000 population. In the Northern Territory, a program called Suicide Story is working to empower Indigenous people, creating a language to talk about suicide, and giving them tools to respond to the warning signs of suicide. The program was developed by Indigenous people and is run by Indigenous people in response to community needs. This paper draws from an evaluation of the program conducted in the Northern Territory at its 10-year mark, in 2018. Although it is impossible to assess how many lives have been saved, this paper takes a position that resilience is an indicator of prevention. One way to achieving this is through culturally safe processes. Based on the evaluation findings, we consider what that means for Suicide Story and other culturally safe suicide prevention programs designed with and for Indigenous people in Australia.","PeriodicalId":37231,"journal":{"name":"Evaluation Journal of Australasia","volume":"22 1","pages":"157 - 172"},"PeriodicalIF":0.0,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43695609","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3

Assessing achievements in place-based initiatives – developing a tailor-made tool 评估基于地方的举措的成就——开发量身定制的工具

Evaluation Journal of Australasia Pub Date : 2022-05-22 DOI: 10.1177/1035719X221102278

P. O’Connor, E. Clune, T. Marriner, Shantanu Sheshgir, J. Waddell

{"title":"Assessing achievements in place-based initiatives – developing a tailor-made tool","authors":"P. O’Connor, E. Clune, T. Marriner, Shantanu Sheshgir, J. Waddell","doi":"10.1177/1035719X221102278","DOIUrl":"https://doi.org/10.1177/1035719X221102278","url":null,"abstract":"Assessing achievements of place-based initiatives (PBIs) has become increasingly important in contemporary evaluation practice. While key characteristics of successful PBIs have been described in the literature, the practicalities of assessing implementation progress across multiple PBIs under the umbrella of a single program invoke complex challenges. This article presents the process used to develop a tool for assessing implementation progress across a 14-site PBI aimed at improving health and education outcomes for First Nations children in Australia. Sites included a mix of metropolitan, regional, remote and very remote locations around Australia and varying levels of PBI maturity. A literature scan identified the attributes of successful PBIs and indicators/measures that could be used to evaluate them. These attributes were condensed into eight domains, and a further two were added due to their importance for this evaluation. The identified indicators and measures were mapped against these domains to generate a question bank. A process of consistently rating sites against the measures relevant to each of them enabled the identification of achievements within each site, comparisons between sites and evaluation of the progress of the program overall. The development of this tool provides a case study for developing a practical, fit-for-purpose tool to evaluate PBIs.","PeriodicalId":37231,"journal":{"name":"Evaluation Journal of Australasia","volume":"22 1","pages":"173 - 192"},"PeriodicalIF":0.0,"publicationDate":"2022-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43328797","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Creating space for gut feelings in the diagnosis of cancer in primary care. 在基层医疗机构诊断癌症时为直觉创造空间。

Evaluation Journal of Australasia Pub Date : 2022-04-28 Print Date: 2022-05-01 DOI: 10.3399/bjgp22X719249

Claire Friedemann Smith, Brian D Nicholson

引用次数: 0