{"title":"A practical application of statistical process control to evaluate the performance rate of academic programmes: implications and suggestions","authors":"A. Gessa, Eyda Marin, Pilar Sancha","doi":"10.1108/qae-03-2022-0065","DOIUrl":"https://doi.org/10.1108/qae-03-2022-0065","url":null,"abstract":"\u0000Purpose\u0000This study aims to properly and objectively assess the students’ study progress in bachelor programmes by applying statistical process control (SPC). Specifically, the authors focused their analysis on the variation in performance rates in business studies courses taught at a Spanish University.\u0000\u0000\u0000Design/methodology/approach\u0000A qualitative methodology was used, using an action-based case study developed in a public university. Previous research and theoretical issues related to quality indicators of the training programmes were discussed, followed by the application of SPC to assess these outputs.\u0000\u0000\u0000Findings\u0000The evaluation of the performance rate of the courses that comprised the training programs through the SPC revealed significant differences with respect to the evaluations obtained through traditional evaluation procedures. Similarly, the results show differences in the control parameters (central line and control interval), depending on the adopted approach (by programmes, by academic year and by department).\u0000\u0000\u0000Research limitations/implications\u0000This study has inherent limitations linked to both the methodology and selection of data sources.\u0000\u0000\u0000Practical implications\u0000The SPC approach provides a framework to properly and objectively assess the quality indicators involved in quality assurance processes in higher education.\u0000\u0000\u0000Originality/value\u0000This paper contributes to the discourse on the importance of a robust and effective assessment of quality indicators of the academic curriculum in the higher education context through the application of quality control tools such as SPC.\u0000","PeriodicalId":46734,"journal":{"name":"QUALITY ASSURANCE IN EDUCATION","volume":" ","pages":""},"PeriodicalIF":1.5,"publicationDate":"2022-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46845500","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Risk management in higher education research: a systematic literature review","authors":"Tze Yin Khaw, A. Teoh","doi":"10.1108/qae-04-2022-0097","DOIUrl":"https://doi.org/10.1108/qae-04-2022-0097","url":null,"abstract":"\u0000Purpose\u0000The growing uncertainty in the world because of economic factors, political issues, natural disasters, global COVID-19 outbreak and technological advancements, make effective risk management (RM) an essential successful strategy for various industries, especially higher education (HE) industry to overcome uncertainties for success. The purpose of this systematic literature review (SLR) is to present a current overview of RM in HE from 2005 to 2021, with a focus on common risk management practised in HE industry, antecedents towards RM implementation and outcomes of RM.\u0000\u0000\u0000Design/methodology/approach\u0000The publication standard for this SLR was RepOrting Standards for Systematics Evidence Syntheses. Scopus, one of the most prominent scientific databases, was used to select articles. Only articles from the years 2005 to 2021 were studied. This study focussed on RM in the HE industry.\u0000\u0000\u0000Findings\u0000This review identified three main themes: common risk management practised in HE industry, antecedents towards RM implementation and outcomes of RM. An additional ten sub-themes were derived from the three main themes.\u0000\u0000\u0000Originality/value\u0000This paper systematically reviewed developments of RM research in HE from year 2005 to 2021, leads to a clearer understanding of RM issues in HE institutions. The findings allow interested parties to better understand RM and enables top management to create their own personalised list of drivers and implementation policies to respond to risks and uncertainties.\u0000","PeriodicalId":46734,"journal":{"name":"QUALITY ASSURANCE IN EDUCATION","volume":" ","pages":""},"PeriodicalIF":1.5,"publicationDate":"2022-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44816749","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Barriers to the efficiency of internal evaluation in Polish secondary schools","authors":"Joanna Oczkowicz, Jan M. Myszewski","doi":"10.1108/qae-03-2022-0078","DOIUrl":"https://doi.org/10.1108/qae-03-2022-0078","url":null,"abstract":"\u0000Purpose\u0000The purpose of this study is to investigate the system of factors influencing the efficiency of internal evaluation in Polish secondary schools.\u0000\u0000\u0000Design/methodology/approach\u0000Data collected in interviews with evaluation experts and teachers on the barriers to the efficiency of internal evaluation and their causes were subjected to a qualitative cause-and-effect analysis.\u0000\u0000\u0000Findings\u0000Five barriers to the evaluation efficiency (6B model) and five actions of the school head stopping their impact (6A model) were identified. The latter include selecting the key evaluation function (3KEF model) and ensuring the conditions for efficiency in the improvement loop.\u0000\u0000\u0000Research limitations/implications\u0000Although the research was carried out in Polish schools, the conclusions indicate regularities affecting organizations throughout the world.\u0000\u0000\u0000Practical implications\u0000Students’ educational needs may exceed the schools’ ability to meet them at class time mostly due to resource constraints. The implementation of the principle of equal opportunities in education requires continuous improvement of the efficiency of schools’ processes. Evaluation can help qualify tasks for improvement.\u0000\u0000\u0000Social implications\u0000The level of engagement (reactive/active) of the school principal and teachers in evaluation and improvement is a crucial factor in overcoming the barriers to the efficiency of the school processes.\u0000\u0000\u0000Originality/value\u0000The ability to respond to the efficiency gaps of the school processes depends on the choice and efficiency of the KEF. The rationale for selecting the function and the schemes for its implementation have paradigmatic grounds.\u0000","PeriodicalId":46734,"journal":{"name":"QUALITY ASSURANCE IN EDUCATION","volume":" ","pages":""},"PeriodicalIF":1.5,"publicationDate":"2022-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44762424","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Measuring learning outcomes: bridging accreditation requirements and LMS functionalities","authors":"Hesham El Marsafawy, Rumpa Roy, Fahema Ali","doi":"10.1108/qae-11-2021-0186","DOIUrl":"https://doi.org/10.1108/qae-11-2021-0186","url":null,"abstract":"\u0000Purpose\u0000This study aims to identify the gap between the requirements of the accreditation bodies and the widely used learning management systems (LMSs) in assessing the intended learning outcomes (ILOs). In addition, this study aims to introduce a framework, along with the evaluation of the functionality of the LMS, for measuring the ILO.\u0000\u0000\u0000Design/methodology/approach\u0000A qualitative method was deployed to examine the gap between the requirements of the accreditation standards and the LMS functionalities. The researchers collaborated to design a mechanism, develop a system architecture to measure the ILO in alignment with the accreditation standards and guide the development of the Moodle plugin. The appropriateness and effectiveness of the plugin were evaluated within the scope of assessment mapping and design. Focus group interviews were conducted to collect feedback from the instructors and program leaders regarding its implementation.\u0000\u0000\u0000Findings\u0000The results of this study indicate that there is no standardized mechanism to measure course and program ILO objectively, using the existing LMS. The implementation of the plugin shows the appropriateness and effectiveness of the system in generating ILO achievement reports, which was confirmed by the users.\u0000\u0000\u0000Originality/value\u0000This study proposed a framework and developed a system architecture for the objective measurement of the ILO through direct assessment. The plugin was tested to generate consistent reports during the measurement of course and program ILO. The plugin has been implemented across Gulf University’s program courses, ensuring appropriate reporting and continuous improvement.\u0000","PeriodicalId":46734,"journal":{"name":"QUALITY ASSURANCE IN EDUCATION","volume":" ","pages":""},"PeriodicalIF":1.5,"publicationDate":"2022-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47253696","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
P. Pohlenz, Annika Felix, Sarah Berndt, Markus Seyfried
{"title":"How do students deal with forced digitalisation in teaching and learning? Implications for quality assurance","authors":"P. Pohlenz, Annika Felix, Sarah Berndt, Markus Seyfried","doi":"10.1108/qae-02-2022-0041","DOIUrl":"https://doi.org/10.1108/qae-02-2022-0041","url":null,"abstract":"\u0000Purpose\u0000This paper aims to investigate student subgroups’ responses to the coercive digitalisation of teaching and learning processes during the pandemic. Respective variance is discussed in terms of digital inequality and is interpreted as a need to individualise teaching and learning and quality assurance practices.\u0000\u0000\u0000Design/methodology/approach\u0000This study uses data from surveys (N = 955) on student perceptions of the introduction of emergency digitalisation – an important aspect of higher education. The authors perform latent class analyses to identify student subgroups. The students were asked to rate digital learning processes and their overall learning experiences.\u0000\u0000\u0000Findings\u0000The identified student subgroups are proponents, pragmatics and sceptics of digitalised teaching and learning processes. These subgroups have different preferences with regard to teaching and learning modes of delivery, which implies the relevance of individualised educational services and respective quality assurance practices to reflections on improvement needs.\u0000\u0000\u0000Research limitations/implications\u0000The data are from a single, typical German university; therefore, the scope of the results may be limited. However, this study enriches future research on the traits of student subgroups and students’ coping strategies in an ever-changing learning environment.\u0000\u0000\u0000Practical implications\u0000The findings may help individualise universities’ counselling services to enhance overall teaching performance and quality assurance practices in a digitalised environment.\u0000\u0000\u0000Originality/value\u0000The findings provide insights into students’ responses to the COVID-19 pandemic and its impact on teaching and learning. This paper enriches the research on student heterogeneity and relates this to development needs of quality assurance practice.\u0000","PeriodicalId":46734,"journal":{"name":"QUALITY ASSURANCE IN EDUCATION","volume":" ","pages":""},"PeriodicalIF":1.5,"publicationDate":"2022-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48443367","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Learning from home: the impact of COVID-19 on teaching and learning","authors":"Soujata Rughoobur-Seetah","doi":"10.1108/qae-01-2022-0026","DOIUrl":"https://doi.org/10.1108/qae-01-2022-0026","url":null,"abstract":"Purpose\u0000With the impact of COVID-19, the educational system across the world had to be reviewed and readapted. Both learners and tutors were forced to adopt the online teaching and learning mechanism. Learners had to cope with the drastic teaching mode. In all of these, the student’s level of satisfaction remains pivotal. Teaching and learning remain successful if the students are satisfied and engaged. Therefore, this study aims to identify and assess factors that influenced students’ level of learning from home satisfaction.\u0000\u0000\u0000Design/methodology/approach\u0000This study followed a mixed-method approach. Online focus groups were arranged to devise indicators for factors like the accessibility of lecturers, support from university and conducive home environment. A questionnaire was designed and disseminated through an online survey. A response rate of (N = 169) was received. The proposed framework was tested in two phases: confirmatory factor analysis and partial least square structural equation modeling.\u0000\u0000\u0000Findings\u0000The findings revealed that education/life balance and learners’ commitment have a positive and significant relationship with learning from home satisfaction. Accessibility of lecturers and a conducive home environment positively influenced education and life balance. Learners’ commitment was influenced by the accessibility of lecturers, education and life balance and support from the university. Support from university was positively influenced by the accessibility of lecturers and a conducive home environment.\u0000\u0000\u0000Originality/value\u0000Various studies focused on the quality of online teaching and learning, and very few studies paid attention to the day-to-day lives of learners at the tertiary level. This study has borrowed organizational factors and adapted them to the students’ lives with two theoretical foundations which will enable a better understanding of the students.","PeriodicalId":46734,"journal":{"name":"QUALITY ASSURANCE IN EDUCATION","volume":" ","pages":""},"PeriodicalIF":1.5,"publicationDate":"2022-08-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41967038","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Prince Agwu, A. Odii, T. Orjiakor, Pallavi Roy, C. Nzeadibe, Chinyere E. Onalu, U. Okoye, O. Onwujekwe
{"title":"Stakeholders’ perspectives on “miracle examination centres” in Nigeria","authors":"Prince Agwu, A. Odii, T. Orjiakor, Pallavi Roy, C. Nzeadibe, Chinyere E. Onalu, U. Okoye, O. Onwujekwe","doi":"10.1108/qae-12-2021-0193","DOIUrl":"https://doi.org/10.1108/qae-12-2021-0193","url":null,"abstract":"\u0000Purpose\u0000The purpose of this study is to describe the nature and operations of schools commonly regarded as “Miracle Examination Centres (MECs)” in Nigeria, through the lens of stakeholders in education. This study also assessed stakeholders’ perspectives on the possible solutions to the problem of MECs.\u0000\u0000\u0000Design/methodology/approach\u0000The study design was a stakeholders’ approach involving 39 key actors within the examination system from northern and southern Nigeria. The stakeholders comprised people from the Ministries of Education (MoE), Examination Councils (EC), school owners and teachers, security agencies and Civil Society Organisations (CSOs) who were invited to interact, interrogate and debate the subject of MECs in Nigeria. Using thematic analysis, recurrent themes were identified from the data and used for a narrative synthesis of the findings.\u0000\u0000\u0000Findings\u0000MECs may attempt to circumvent quality assurance and regulatory requirements and may find support from prominent leaders and members of the communities through a wider informal economy. Interventions against MECs might only yield incremental results and must involve various groups like CSOs, anti-corruption agencies, EC and faith- and community-based groups. These interventions will be even more effective if the MoE will strengthen its integrity and improve its monitoring and regulatory functions without political interference.\u0000\u0000\u0000Originality/value\u0000This paper revealed that improving examination integrity and building a solid and reliable secondary educational level in Nigeria will be achieved through the combination of horizontal and vertical approaches that involve local actors and those in authority.\u0000","PeriodicalId":46734,"journal":{"name":"QUALITY ASSURANCE IN EDUCATION","volume":" ","pages":""},"PeriodicalIF":1.5,"publicationDate":"2022-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47934017","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Assessment of student readiness for clinical education in mixed-mode curriculum delivery: a case study","authors":"L. White, K. Jordan, Heidi Mcdermott","doi":"10.1108/qae-02-2022-0044","DOIUrl":"https://doi.org/10.1108/qae-02-2022-0044","url":null,"abstract":"\u0000Purpose\u0000The purpose of this case study is to describe a simulation-based assessment designed to assure student readiness for a first full-time clinical experience in an entry-level Doctor of Physical Therapy program that transitioned to mixed-mode instruction during the COVID-19 pandemic.\u0000\u0000\u0000Design/methodology/approach\u0000A cohort of 40 second-year physical therapy students whose content delivery mode, assessment methods and curricular sequence deviated from the curricular plan participated in a new assessment using standardized patients. The assessment was developed to preferentially address the knowledge, skills, abilities and professional behaviors (KSAs) that were typically assessed with other methods before the pandemic.\u0000\u0000\u0000Findings\u0000The assessment was useful in identifying students who required additional learning experiences to meet expected levels of competence before transition to a first full-time clinical experience. It also identified KSAs that needed to be strengthened within the entire cohort of students.\u0000\u0000\u0000Research limitations/implications\u0000This case study provides an example of feasible implementation of an assessment of student readiness for clinical education that may guide future development of standardized assessments in health profession education (HPE) programs that have or plan to transition to mixed-mode content delivery.\u0000\u0000\u0000Originality/value\u0000This case study highlights the need and process for developing and implementing additional assessments in HPE programs when planned changes or unexpected variations in curriculum delivery occur. This evidence-based assessment preferentially addresses the affective domain of learning and includes competency standards that have recently been developed for physical therapy education in the USA.\u0000","PeriodicalId":46734,"journal":{"name":"QUALITY ASSURANCE IN EDUCATION","volume":" ","pages":""},"PeriodicalIF":1.5,"publicationDate":"2022-07-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43170639","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Assuring online assessment quality: the case of unproctored online assessment","authors":"L. Lin, D. Foung, Julia Chen","doi":"10.1108/qae-02-2022-0048","DOIUrl":"https://doi.org/10.1108/qae-02-2022-0048","url":null,"abstract":"\u0000Purpose\u0000This study aims to examine the impact of the transformation of an assessment on students’ performance and perspectives in an English for Academic Purposes course in Hong Kong. The assessment was changed from the traditional pen-and-paper mode to an unproctored online mode.\u0000\u0000\u0000Design/methodology/approach\u0000Using mixed methods, the research team analysed the differences between the assessment performances of those who took the course before the pandemic (n = 664) and those who took it during the pandemic (n = 702). Furthermore, focus group interviews were conducted with seven students regarding their perspectives on the unproctored assessment.\u0000\u0000\u0000Findings\u0000The results revealed that, although there were no major differences in the overall grades of the two groups, students who were assessed online during the pandemic performed significantly better in terms of their English use. Nevertheless, the shift to online assessment had several negative effects on the students.\u0000\u0000\u0000Originality/value\u0000Previous studies on unproctored online assessments (UOA) were concerned with potential learning quality issues, such as plagiarism and grade inflation. This study, however, provided empirical evidence that high-quality assessment delivery can be provided via UOA if the question types and assessment arrangements are carefully decided.\u0000","PeriodicalId":46734,"journal":{"name":"QUALITY ASSURANCE IN EDUCATION","volume":" ","pages":""},"PeriodicalIF":1.5,"publicationDate":"2022-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41820655","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Implementation of a blended learning course for adult learners during the COVID-19 pandemic","authors":"I. Luka","doi":"10.1108/qae-03-2022-0061","DOIUrl":"https://doi.org/10.1108/qae-03-2022-0061","url":null,"abstract":"\u0000Purpose\u0000This study aims to evaluate a culture-based blended learning multilingual course created for adult learners in ten languages and the development of learners’ 21st-century skills during its implementation in six European countries – Croatia, Latvia, Slovenia, Romania, Poland and Czechia in the COVID-19 period.\u0000\u0000\u0000Design/methodology/approach\u0000A cross-sectional survey of 638 participants was conducted using a paper-based questionnaire. Data analysis was carried out applying Bereday’s four-step model comprising description, interpretation, juxtaposition and comparison to find out similarities and differences among various groups of learners.\u0000\u0000\u0000Findings\u0000Overall, learners have developed their 21st-century skills, but the improvement has not been the same for all target audiences. Learners with economic, social and cultural barriers were more positive in their evaluation than those with geographic and learning obstacles.\u0000\u0000\u0000Research limitations/implications\u0000The research was conducted during the COVID-19 pandemic, and the face-to-face stage was replaced with online learning on virtual platforms, which impacted the research results. The results cannot be generalized to all adult learners as significant differences were discovered among various target groups of learners.\u0000\u0000\u0000Practical implications\u0000The course may be implemented for formal and non-formal adult education when face-to-face teaching/learning is restricted.\u0000\u0000\u0000Social implications\u0000The findings indicate that the course is especially suitable for learners with economic, social and cultural obstacles to learning.\u0000\u0000\u0000Originality/value\u0000The article focuses on the use of blended learning in non-formal/informal adult education, which is a less widely researched area. The target course implemented during the COVID-19 pandemic shows a novel way of engaging adult learners in lifelong learning, including those with certain barriers to learning.\u0000","PeriodicalId":46734,"journal":{"name":"QUALITY ASSURANCE IN EDUCATION","volume":" ","pages":""},"PeriodicalIF":1.5,"publicationDate":"2022-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45335214","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}