Toufeeq Ahmed Syed, Erika L Thompson, Jason Johnson, Zainab Latif, Nan Kennedy, Damaris Javier, Katie Stinson, Jamboor K Vishwanatha
{"title":"通过国家研究指导网络对用户注册表格进行 A/B 测试,以增强生物医学劳动力的多样性:以用户为中心的设计案例研究。","authors":"Toufeeq Ahmed Syed, Erika L Thompson, Jason Johnson, Zainab Latif, Nan Kennedy, Damaris Javier, Katie Stinson, Jamboor K Vishwanatha","doi":"10.2196/54532","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>The National Research Mentoring Network (NRMN) is a National Institutes of Health-funded program for diversifying the science, technology, engineering, math, and medicine research workforce through the provision of mentoring, networking, and professional development resources. The NRMN provides mentoring resources to members through its online platform-MyNRMN.</p><p><strong>Objective: </strong>MyNRMN helps members build a network of mentors. Our goal was to expand enrollment and mentoring connections, especially among those who have been historically underrepresented in biomedical training and the biomedical workforce.</p><p><strong>Methods: </strong>To improve the ease of enrollment, we implemented the split testing of iterations of our user interface for platform registration. To increase mentoring connections, we developed multiple features that facilitate connecting via different pathways.</p><p><strong>Results: </strong>Our improved user interface yielded significantly higher rates of completed registrations (P<.001). Our analysis showed improvement in completed enrollments that used the version 1 form when compared to those that used the legacy form (odds ratio 1.52, 95% CI 1.30-1.78). The version 2 form, with its simplified, 1-step process and fewer required fields, outperformed the legacy form (odds ratio 2.18, 95% CI 1.90-2.50). By improving the enrollment form, the rate of MyNRMN enrollment completion increased from 57.3% (784/1368) with the legacy form to 74.5% (2016/2706) with the version 2 form. Our newly developed features delivered an increase in connections between members.</p><p><strong>Conclusions: </strong>Our technical efforts expanded MyNRMN's membership base and increased connections between members. Other platform development teams can learn from these efforts to increase enrollment among underrepresented groups and foster continuing, successful engagement.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e54532"},"PeriodicalIF":2.6000,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11231449/pdf/","citationCount":"0","resultStr":"{\"title\":\"A/B Testing of User Enrollment Forms to Enhance Diversity in the Biomedical Workforce via the National Research Mentoring Network: User-Centered Design Case Study.\",\"authors\":\"Toufeeq Ahmed Syed, Erika L Thompson, Jason Johnson, Zainab Latif, Nan Kennedy, Damaris Javier, Katie Stinson, Jamboor K Vishwanatha\",\"doi\":\"10.2196/54532\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>The National Research Mentoring Network (NRMN) is a National Institutes of Health-funded program for diversifying the science, technology, engineering, math, and medicine research workforce through the provision of mentoring, networking, and professional development resources. The NRMN provides mentoring resources to members through its online platform-MyNRMN.</p><p><strong>Objective: </strong>MyNRMN helps members build a network of mentors. Our goal was to expand enrollment and mentoring connections, especially among those who have been historically underrepresented in biomedical training and the biomedical workforce.</p><p><strong>Methods: </strong>To improve the ease of enrollment, we implemented the split testing of iterations of our user interface for platform registration. To increase mentoring connections, we developed multiple features that facilitate connecting via different pathways.</p><p><strong>Results: </strong>Our improved user interface yielded significantly higher rates of completed registrations (P<.001). Our analysis showed improvement in completed enrollments that used the version 1 form when compared to those that used the legacy form (odds ratio 1.52, 95% CI 1.30-1.78). The version 2 form, with its simplified, 1-step process and fewer required fields, outperformed the legacy form (odds ratio 2.18, 95% CI 1.90-2.50). By improving the enrollment form, the rate of MyNRMN enrollment completion increased from 57.3% (784/1368) with the legacy form to 74.5% (2016/2706) with the version 2 form. Our newly developed features delivered an increase in connections between members.</p><p><strong>Conclusions: </strong>Our technical efforts expanded MyNRMN's membership base and increased connections between members. Other platform development teams can learn from these efforts to increase enrollment among underrepresented groups and foster continuing, successful engagement.</p>\",\"PeriodicalId\":36351,\"journal\":{\"name\":\"JMIR Human Factors\",\"volume\":\"11 \",\"pages\":\"e54532\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2024-07-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11231449/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"JMIR Human Factors\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.2196/54532\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"HEALTH CARE SCIENCES & SERVICES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"JMIR Human Factors","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2196/54532","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
A/B Testing of User Enrollment Forms to Enhance Diversity in the Biomedical Workforce via the National Research Mentoring Network: User-Centered Design Case Study.
Background: The National Research Mentoring Network (NRMN) is a National Institutes of Health-funded program for diversifying the science, technology, engineering, math, and medicine research workforce through the provision of mentoring, networking, and professional development resources. The NRMN provides mentoring resources to members through its online platform-MyNRMN.
Objective: MyNRMN helps members build a network of mentors. Our goal was to expand enrollment and mentoring connections, especially among those who have been historically underrepresented in biomedical training and the biomedical workforce.
Methods: To improve the ease of enrollment, we implemented the split testing of iterations of our user interface for platform registration. To increase mentoring connections, we developed multiple features that facilitate connecting via different pathways.
Results: Our improved user interface yielded significantly higher rates of completed registrations (P<.001). Our analysis showed improvement in completed enrollments that used the version 1 form when compared to those that used the legacy form (odds ratio 1.52, 95% CI 1.30-1.78). The version 2 form, with its simplified, 1-step process and fewer required fields, outperformed the legacy form (odds ratio 2.18, 95% CI 1.90-2.50). By improving the enrollment form, the rate of MyNRMN enrollment completion increased from 57.3% (784/1368) with the legacy form to 74.5% (2016/2706) with the version 2 form. Our newly developed features delivered an increase in connections between members.
Conclusions: Our technical efforts expanded MyNRMN's membership base and increased connections between members. Other platform development teams can learn from these efforts to increase enrollment among underrepresented groups and foster continuing, successful engagement.