Barriers and Facilitators of Using R for Decision Analytic Modeling in Health Technology Assessment: Focus Group Results

Background and Objective

Decision models for health technology assessment (HTA) are largely submitted to HTA agencies using commercial software, which has known limitations. The use of the open-source programming language R has been suggested because of its efficiency, transparency, reproducibility, and ability to consider complex analyses. However, its use in HTA remains limited. This qualitative study aimed to explore the main reasons for this slow uptake of R in HTA and identify tangible facilitators.

Methods

We undertook two semi-structured focus group discussions with 24 key stakeholders from government agencies, consultancy, pharmaceutical companies, and academia. Two 1.5-hour discussions reflected on barriers identified in a previous study and highlighted additional barriers. Discussions were recorded and semi-transcribed, and data were organized and summarized into key themes.

Results

Human resources constraints were identified as a key barrier, including a lack of training, prioritization and collaboration, and resistance to change. Another key barrier was the lack of acceptance, or clear guidance, around submissions in R by HTA agencies. Participants also highlighted a lack of communication around accepted packages and decision model structures, and between HTA agencies on standard decision modeling structures.

Conclusions

There is a need for standardization, which can facilitate decision model sharing, coding homogeneity, and improved country adaptations. The creation of training materials and tailored workshops was identified as a key short-term facilitator. Increased communication and engagement of stakeholders could also facilitate the use of R by identifying needs and opportunities, encouraging HTA agencies to address structural barriers, and increasing incentives to use R.