Benjamin Lee , Georgia Bridges , Chiao X. Lim , Jenny Devine , Senthil Lingaratnam , Safeera Y. Hussainy
{"title":"Usability testing of an online, evidence-based pharmacogenomics education program for pharmacists working in cancer care","authors":"Benjamin Lee , Georgia Bridges , Chiao X. Lim , Jenny Devine , Senthil Lingaratnam , Safeera Y. Hussainy","doi":"10.1016/j.cptl.2025.102478","DOIUrl":null,"url":null,"abstract":"<div><h3>Introduction</h3><div>Usability testing provides valuable information when ensuring newly developed education programs are deemed acceptable to the target audience. The aim is to evaluate the usability of an online, evidence-based pharmacogenomics education program, developed in-house, to subsequently improve the user experience before wide scale implementation to pharmacists at an Australian public oncology hospital.</div></div><div><h3>Methods</h3><div>The methodology was adapted from Benedict et al. (2022) with permission. Five pharmacist-users tested up to two of eight modules utilising the think-aloud method. Participants' video, audio and screens were recorded, with automated audio transcription. A facilitator was present to prompt verbalisation of thoughts, ask standard pre- and post-usability testing questions, and guide users to complete three quantitative instruments; System Usability Scale (SUS), Standardised User Experience Percentile Rank Question (SUPR-Q) and WebQual. Two researchers employed reflexive thematic analysis.</div></div><div><h3>Results</h3><div>Four themes were finalised based on generated codes; recognition of usefulness of content, factors inhibiting understanding, acceptable user experience and poor user experience. The mean SUS and SUPR-Q scores were 83.1 (SD 14.9) and 4.6 (SD 0.2) respectively, and the overall mean WebQual score was 6.1 (SD 0.2), all indicating good usability. Overall, pharmacists valued the program content and found the format visually satisfying and engaging.</div></div><div><h3>Discussion</h3><div>The education program was found to be acceptable, useful, and a positive learning experience for pharmacists prior to practicing in pharmacogenomics. Results were used to inform changes to the program to further enhance the user experience.</div></div><div><h3>Conclusion</h3><div>Process, outcome and implementation evaluation will be conducted after program rollout.</div></div>","PeriodicalId":47501,"journal":{"name":"Currents in Pharmacy Teaching and Learning","volume":"17 12","pages":"Article 102478"},"PeriodicalIF":1.4000,"publicationDate":"2025-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Currents in Pharmacy Teaching and Learning","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1877129725001996","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}
引用次数: 0
Abstract
Introduction
Usability testing provides valuable information when ensuring newly developed education programs are deemed acceptable to the target audience. The aim is to evaluate the usability of an online, evidence-based pharmacogenomics education program, developed in-house, to subsequently improve the user experience before wide scale implementation to pharmacists at an Australian public oncology hospital.
Methods
The methodology was adapted from Benedict et al. (2022) with permission. Five pharmacist-users tested up to two of eight modules utilising the think-aloud method. Participants' video, audio and screens were recorded, with automated audio transcription. A facilitator was present to prompt verbalisation of thoughts, ask standard pre- and post-usability testing questions, and guide users to complete three quantitative instruments; System Usability Scale (SUS), Standardised User Experience Percentile Rank Question (SUPR-Q) and WebQual. Two researchers employed reflexive thematic analysis.
Results
Four themes were finalised based on generated codes; recognition of usefulness of content, factors inhibiting understanding, acceptable user experience and poor user experience. The mean SUS and SUPR-Q scores were 83.1 (SD 14.9) and 4.6 (SD 0.2) respectively, and the overall mean WebQual score was 6.1 (SD 0.2), all indicating good usability. Overall, pharmacists valued the program content and found the format visually satisfying and engaging.
Discussion
The education program was found to be acceptable, useful, and a positive learning experience for pharmacists prior to practicing in pharmacogenomics. Results were used to inform changes to the program to further enhance the user experience.
Conclusion
Process, outcome and implementation evaluation will be conducted after program rollout.