Li Jiu, Junfeng Wang, Jan-Willem Versteeg, Yingying Zhang, Lifang Liu, Francisco Javier Somolinos-Simón, Jose Tapia-Galisteo, Gema García-Sáez, Milou A Hogervorst, Xinyu Li, Aukje K Mantel-Teeuwisse, Wim G Goettsch
{"title":"Roadmap to Innovation of HTA Methods (IHTAM): insights from three case studies of quantitative methods.","authors":"Li Jiu, Junfeng Wang, Jan-Willem Versteeg, Yingying Zhang, Lifang Liu, Francisco Javier Somolinos-Simón, Jose Tapia-Galisteo, Gema García-Sáez, Milou A Hogervorst, Xinyu Li, Aukje K Mantel-Teeuwisse, Wim G Goettsch","doi":"10.1017/S0266462324000564","DOIUrl":"https://doi.org/10.1017/S0266462324000564","url":null,"abstract":"<p><strong>Objectives: </strong>A conceptual framework, called Innovation of Health Technology Assessment Methods (IHTAM), has been developed to facilitate the understanding of how to innovate methods of health technology assessment (HTA). However, the framework applicability has not been evaluated in practice. Hence, we aimed to explore framework applicability in three cases of method innovation that are part of the HTx project and to develop a roadmap to improve framework applicability.</p><p><strong>Methods: </strong>The IHTAM framework was applied to three cases of innovating HTA methods. We collected feedback from case study leaders and consortium members after a training session, an approximately 1-year follow-up of periodic case study meetings, and a general assembly meeting where innovation progresses of the three cases were reported through surveys and interviews. Feedback was then summarized using an open-coding technique.</p><p><strong>Results: </strong>According to feedback, the framework provided a structured way of deliberation and helped to improve collaboration among HTA stakeholders. However, framework applicability could be improved if it was complemented by a roadmap with a loop structure to provide tailored guidance for different cases, and with items to elaborate actions to be taken by stakeholders. Accordingly, a 48-item roadmap was developed.</p><p><strong>Conclusions: </strong>The IHTAM framework was generally applicable to the three case studies. A roadmap, with loop structure and actionable items, could complement the framework, and may provide HTA stakeholders with tailored guidance on developing new methods. To further examine the framework applicability, we recommend stakeholders to apply the IHTAM framework and its roadmap in future practice.</p>","PeriodicalId":14467,"journal":{"name":"International Journal of Technology Assessment in Health Care","volume":null,"pages":null},"PeriodicalIF":2.6,"publicationDate":"2024-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142575922","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Layla Bakaa, Fatima Al-Mosawi, Nora Bakaa, Lisandra Almeida de Oliveira, Maude Laberge, Luciana G Macedo
{"title":"Content validation of the COST for patient questionnaire (COPAQ) for patients with low back pain: a qualitative study.","authors":"Layla Bakaa, Fatima Al-Mosawi, Nora Bakaa, Lisandra Almeida de Oliveira, Maude Laberge, Luciana G Macedo","doi":"10.1017/S0266462324000515","DOIUrl":"10.1017/S0266462324000515","url":null,"abstract":"<p><strong>Introduction: </strong>The costs of low back pain (LBP) are complex and difficult to estimate. This study aims to adapt the Cost for Patients Questionnaire (CoPaQ) for use in LBP populations.</p><p><strong>Materials and methods: </strong>In a cross-sectional qualitative study, we conducted cognitive interviews to assess the CoPaQ's suitability for addressing costs related to LBP. Three groups of participants were included (<i>n</i> = 5 each): (i) persons with a history of LBP or primary caregiver, (ii) researchers with expertise in LBP, and (iii) primary care providers specialized in treating LBP. The interpretation, analysis, and summary of results used Knafl et al.'s qualitative content analysis method.</p><p><strong>Results: </strong>Persons with a history of LBP (<i>n</i> = 5), had a median age of 60 years (Interquartile Range (IQR): 26-71.5), and varying durations of LBP, the median duration of LBP 7 years (IQR: 4-32.5). Researchers (<i>n</i> = 5) had a median age of 33 years (IQR: 29-45). Primary care providers (<i>n</i> = 5) had a median age of 40 years (IQR: 37.5-65), and a background in chiropractic care (<i>n</i> = 3) and physiotherapy (<i>n</i> = 2). Content analysis of the interviews revealed sources of error with five pre-determined themes (clarity/comprehension, relevance, inadequate response definition, reference point, perspective modifiers) and one developed theme (organization). We modified the questionnaire for LBP populations based on the feedback.</p><p><strong>Conclusion: </strong>Our study evaluated the content validity of a questionnaire that assesses the direct and indirect costs associated with LBP. Future studies should pilot this questionnaire with persons of varying LBP severity and compare it with cost diaries.</p>","PeriodicalId":14467,"journal":{"name":"International Journal of Technology Assessment in Health Care","volume":null,"pages":null},"PeriodicalIF":2.6,"publicationDate":"2024-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142575919","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ingrid Zechmeister-Koss, Gregor Götz, Daniel Fabian, Claudia Wild
{"title":"The role of health economics within health technology assessment: past, present, and future - an Austrian perspective.","authors":"Ingrid Zechmeister-Koss, Gregor Götz, Daniel Fabian, Claudia Wild","doi":"10.1017/S0266462324000503","DOIUrl":"10.1017/S0266462324000503","url":null,"abstract":"<p><p>In many countries, the economics domain forms a routine part of health technology assessments (HTA) next to analyzing the comparative effectiveness and safety of a technology. The method applied most often is economic evaluation, such as cost-effectiveness analysis, which is supposed to support the efficient use of resources. In Austria, economic evaluation has played a negligible role in HTA and reimbursement decisions, even though the country faces the same public healthcare sustainability challenges as others. In this commentary, we argue that while health economics will need to play a more active role in HTA-related decision support to deal with those challenges, current approaches in other countries may have to be broadened to fit the Austrian context. We are outlining four arguments to underpin this perspective: First, economic evaluations (in their current form) are of limited benefit for supporting reimbursement decisions of new high-priced technologies. Second, a broader variety of health economic methods is needed to address the scope of technologies. Third, applying health economic methods requires a reflection on their underlying values. Finally, health economics within HTA needs to go beyond microeconomic analysis of interventions. We are suggesting several alternative methods and approaches, encouraging out-of-the-box thinking and experimenting with methods developed in the academic context but rarely applied in routine HTA. Although some of our topics are unique to Austria, others may equally apply to other healthcare systems. With our thoughts, we aim to stimulate discussions for further developing health economics within HTA in Austria and internationally.</p>","PeriodicalId":14467,"journal":{"name":"International Journal of Technology Assessment in Health Care","volume":null,"pages":null},"PeriodicalIF":2.6,"publicationDate":"2024-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142575937","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Is health technology assessment ready for generative pretrained transformer large language models? Report of a fishbowl inquiry.","authors":"Clifford Goodman, Ellie Treloar","doi":"10.1017/S0266462324000382","DOIUrl":"10.1017/S0266462324000382","url":null,"abstract":"<p><strong>Objectives: </strong>The Health Technology Assessment International (HTAi) 2023 Annual Meeting included a novel \"fishbowl\" session intended to 1) probe the role of HTA in the emergence of generative pretrained transformer (GPT) large language models (LLMs) into health care and 2) demonstrate the semistructured, interactive fishbowl process applied to an emerging \"hot topic\" by diverse international participants.</p><p><strong>Methods: </strong>The fishbowl process is a format for conducting medium-to-large group discussions. Participants are separated into an inner group and an outer group on the periphery. The inner group responds to a set of questions, whereas the outer group listens actively. During the session, participants voluntarily enter and leave the inner group. The questions for this fishbowl were: What are current and potential future applications of GPT LLMs in health care? How can HTA assess intended and unintended impacts of GPT LLM applications in health care? How might GPT be used to improve HTA methodology?</p><p><strong>Results: </strong>Participants offered approximately sixty responses across the three questions. Among the prominent themes were: improving operational efficiency, terminology and language, training and education, evidence synthesis, detecting and minimizing biases, stakeholder engagement, and recognizing and accounting for ethical, legal, and social implications.</p><p><strong>Conclusions: </strong>The interactive fishbowl format enabled the sharing of real-time input on how GPT LLMs and related disruptive technologies will influence what technologies will be assessed, how they will be assessed, and how they might be used to improve HTA. It offers novel perspectives from the HTA community and aligns with certain aspects of ongoing HTA and evidence framework development.</p>","PeriodicalId":14467,"journal":{"name":"International Journal of Technology Assessment in Health Care","volume":null,"pages":null},"PeriodicalIF":2.6,"publicationDate":"2024-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142575920","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Rebecca Trowman, Antonio Migliore, Daniel A Ollendorf
{"title":"Designing collaborations involving health technology assessment: discussions and recommendations from the 2024 health technology assessment international global policy forum.","authors":"Rebecca Trowman, Antonio Migliore, Daniel A Ollendorf","doi":"10.1017/S0266462324000436","DOIUrl":"10.1017/S0266462324000436","url":null,"abstract":"<p><p>Although collaboration is an intensive way of working together, it is essential for such efforts to achieve shared goals. Health technology assessment (HTA) is transdisciplinary and has an important history of collaboration, with collaboration featuring increasingly in the strategic plans of HTA bodies and stakeholders. Collaboration can be between HTA bodies and between HTA bodies and other stakeholders-most notably regulators but increasingly payers, patient and caregiver organizations, clinicians-clinical societies, and academia. The 2024 HTAi Global Policy Forum (GPF) discussed collaborations involving HTA bodies, reviewing existing and previous collaborations to see what has worked and what can be learned. Core discussion themes included: (i) determining the collaboration purpose is essential but may be dynamic, changing over time; (ii) choosing the collaboration topic takes time, requiring upfront investment and stakeholder mapping; (iii) inviting the right participants and treating them equally is important, including those who can impact HTA, those who will be impacted by HTA and those who bring new information; (iv) collaborations need clear governance, defined roles, responsibilities, metrics, and case study-pilots can be a useful operational model; (v) resourcing collaborations sustainably is a challenge-the time, people, and money required are often under-estimated; (vi) undertaking continual, iterative learning reviews ensures ongoing value and impact of collaborations. Recommendations for future work include the development of a \"go/no-go\" checklist to determine when collaboration is needed, supplemented with a set of \"best practice\" principles for establishing and working in collaborations involving HTA bodies.</p>","PeriodicalId":14467,"journal":{"name":"International Journal of Technology Assessment in Health Care","volume":null,"pages":null},"PeriodicalIF":2.6,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142568457","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jamie Elvidge, Nick Crabb, Diana Delnoij, Saskia Knies, Douglas Lundin, François Houÿez, Juha Röning, Junfeng Wang, Li Jiu, Alastair Bennett, Yingying Zhang, Dalia Dawoud
{"title":"Implementing a sandbox approach in health technology assessment: benefits and recommendations.","authors":"Jamie Elvidge, Nick Crabb, Diana Delnoij, Saskia Knies, Douglas Lundin, François Houÿez, Juha Röning, Junfeng Wang, Li Jiu, Alastair Bennett, Yingying Zhang, Dalia Dawoud","doi":"10.1017/S0266462324000412","DOIUrl":"10.1017/S0266462324000412","url":null,"abstract":"<p><strong>Objectives: </strong>The sandbox approach, developed in the financial technologies sector, creates an environment to collaboratively develop and test innovative new products, methods and regulatory approaches, separated from business as usual. It has been used in health care to encourage innovation in response to emerging challenges, but, until recently, has not been used in health technology assessment (HTA). This article summarizes our learnings from using the sandbox approach to address three challenges facing HTA organizations and to identify implications for the use of this approach in HTA.</p><p><strong>Methods: </strong>We identified three challenging contemporary HTA-related topics to explore in a sandbox environment, away from the pressures and interests of \"live\" assessments. We convened a pool of 120 stakeholders and experts to participate in various sandbox activities and ultimately co-develop solutions to help HTA organizations respond to the identified challenges.</p><p><strong>Results: </strong>Important general learnings about the potential benefits and implementation of a sandbox approach in HTA were identified. Consequently, we developed recommendations to guide its use, including how to implement an HTA sandbox in an effective way and the types of challenges for which it may be best suited.</p><p><strong>Conclusions: </strong>For many HTA organizations, it is difficult to carefully consider emerging challenges and innovate their processes due to risks associated with decision errors and resource limitations. The sandbox approach could reduce these barriers. The potential benefits of addressing HTA challenges in a collaborative \"safe space\" are considerable.</p>","PeriodicalId":14467,"journal":{"name":"International Journal of Technology Assessment in Health Care","volume":null,"pages":null},"PeriodicalIF":2.6,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142568478","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The newcomer's guide to health technology assessment: a collection of resources for early career professionals.","authors":"Antonio Migliore, Debjani Mueller, Wija Oortwijn","doi":"10.1017/S0266462324000424","DOIUrl":"https://doi.org/10.1017/S0266462324000424","url":null,"abstract":"","PeriodicalId":14467,"journal":{"name":"International Journal of Technology Assessment in Health Care","volume":null,"pages":null},"PeriodicalIF":2.6,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142568482","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pietro Refolo, Katherine Duthie, Björn Hofmann, Michal Stanak, Neil Bertelsen, Bart Bloemen, Rosella Di Bidino, Wija Oortwijn, Costanza Raimondi, Dario Sacchini, Gert Jan van der Wilt, Kenneth Bond
{"title":"Ethical challenges for Health Technology Assessment (HTA) in the evolving evidence landscape.","authors":"Pietro Refolo, Katherine Duthie, Björn Hofmann, Michal Stanak, Neil Bertelsen, Bart Bloemen, Rosella Di Bidino, Wija Oortwijn, Costanza Raimondi, Dario Sacchini, Gert Jan van der Wilt, Kenneth Bond","doi":"10.1017/S0266462324000394","DOIUrl":"https://doi.org/10.1017/S0266462324000394","url":null,"abstract":"<p><p>Since its inception, Health Technology Assessment (HTA) has typically determined the value of a technology by collecting information derived from randomized clinical trials (RCTs), in line with the principles of evidence-based medicine (EBM). However, data from RCTs did not constitute the sole source of information, as other types of evidence (such as primary qualitative research) have often been utilized. Recent advances in both generating and collecting other types of evidence are broadening the landscape of evidence, adding complexity to the discussion of \"robustness of evidence.\" What are the consequences of these recent developments for the methodology and conduct of HTA, the HTA community, and its ethical commitments? The aim of this article is to explore some ethical challenges that are emerging in the current evolving evidence landscape, particularly changes in evidence generation and collection (e.g., diversification of data sources), and shifting standards of evidence in the field of HTA (e.g., increasing acceptability of evidence that is thought of as lower quality). Our conclusion is that deciding how to best maintain trustworthiness is common to all these issues.</p>","PeriodicalId":14467,"journal":{"name":"International Journal of Technology Assessment in Health Care","volume":null,"pages":null},"PeriodicalIF":2.6,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142568462","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ryan Rachmad Nugraha, Christian Suharlim, Rozar Prawiranegara, Arry Lesmana Putra, Mutia A Sayekti, Armansyah Armansyah, Lusiana Siti Masytoh, Sweta Saxena, Anastasia Susanto, John C Langerbrunner, Nurul Maretia Rahmayanti, Miyoung Choi, Budi Wiweko, Budi Hidayat
{"title":"A framework for improved collaboration on HTA in the Asia-Pacific region: a role for HTAsiaLink.","authors":"Ryan Rachmad Nugraha, Christian Suharlim, Rozar Prawiranegara, Arry Lesmana Putra, Mutia A Sayekti, Armansyah Armansyah, Lusiana Siti Masytoh, Sweta Saxena, Anastasia Susanto, John C Langerbrunner, Nurul Maretia Rahmayanti, Miyoung Choi, Budi Wiweko, Budi Hidayat","doi":"10.1017/S0266462324000588","DOIUrl":"https://doi.org/10.1017/S0266462324000588","url":null,"abstract":"<p><p>Countries frequently use health technology assessment (HTA) to set priorities for introducing new interventions or evaluating existing interventions; however, applying the tool effectively is heavily dependent on a country's resources and capacity. Infrastructure and data, technical expertise, broad stakeholder involvement, and financial support are required to improve HTA processes. In the Asia-Pacific, HTAsiaLink was established to facilitate this practice, but strengthening and legitimizing this organization are needed to maximize its potential to support HTA institutionalization in the region. To realize this objective, HTAsiaLink can serve as a center of excellence while providing experiential learning and sharing information. As a learning hub, HTAsiaLink can share resources-particularly data-that can contribute to joint HTAs as done in the European Union and strengthen capacity in countries needing to develop their HTA expertise.</p>","PeriodicalId":14467,"journal":{"name":"International Journal of Technology Assessment in Health Care","volume":null,"pages":null},"PeriodicalIF":2.6,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142568452","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Denny John, Abhirup Dutta Majumdar, Rakesh N Pillai, Sajda Khatoon, Paramita Bhattacharya, Nirmalya Mukherjee, Jaideep R Menon, K Pavithran, Anand Kumar, Mihajlo Jakovljevic
{"title":"Health Technology Assessment for digital health technologies in India: A framework for action.","authors":"Denny John, Abhirup Dutta Majumdar, Rakesh N Pillai, Sajda Khatoon, Paramita Bhattacharya, Nirmalya Mukherjee, Jaideep R Menon, K Pavithran, Anand Kumar, Mihajlo Jakovljevic","doi":"10.1017/S0266462324000345","DOIUrl":"https://doi.org/10.1017/S0266462324000345","url":null,"abstract":"","PeriodicalId":14467,"journal":{"name":"International Journal of Technology Assessment in Health Care","volume":null,"pages":null},"PeriodicalIF":2.6,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142568448","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}