Quality and Reliability of Adolescent Sexuality Education on Chinese Video Platforms: Sentiment-Topic Analysis and Cross-Sectional Study.

IF 2 Q3 HEALTH CARE SCIENCES & SERVICES
Lan Wang, Xiantao Shu, Jianmei Huang, Weiqian Yan, Duo Zhao
{"title":"Quality and Reliability of Adolescent Sexuality Education on Chinese Video Platforms: Sentiment-Topic Analysis and Cross-Sectional Study.","authors":"Lan Wang, Xiantao Shu, Jianmei Huang, Weiqian Yan, Duo Zhao","doi":"10.2196/77100","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Adolescence is a critical period for lifelong health, which makes access to accurate and comprehensive sexuality education essential. As video platforms become a primary source of information for adolescents, the quality of their content significantly impacts their physical and mental health.</p><p><strong>Objective: </strong>This study aimed to evaluate the quality, reliability, understandability, and actionability of adolescent sexuality education videos on major Chinese platforms (Bilibili, TikTok or Douyin, and Kwai), analyze associated user comment sentiment and topics, identify predictors of quality and reliability, and provide recommendations.</p><p><strong>Methods: </strong>A cross-sectional analysis was conducted (April 2025) on the top 100 comprehensively ranked comprehensive sexuality education videos (N=300 total) retrieved from each platform using the keyword (\"adolescent sexuality education\"). Videos were assessed using the Global Quality Score, modified DISCERN, and Patient Education Materials Assessment Tool (PEMAT-U/A), with interrater reliability assessed via Cohen κ. A corpus of over 49,000 user comments underwent sentiment analysis (fine-tuned RoBERTa) and topic modeling (BERTopic, yielding 29 topics grouped into 6 themes). Statistical analyses included Kruskal-Wallis H tests, Spearman correlations, and stepwise linear regressions (SPSS [version 27.0]; P<.05).</p><p><strong>Results: </strong>Video quality and reliability were moderate on Bilibili and TikTok but generally poor on Kwai. Content from verified sources (physicians, educators, and institutional media) demonstrated superior quality and stability compared to highly variable content from individual media (the predominant source type, especially on Kwai; 87/100, 87%). Paradoxically, Kwai exhibited the highest user engagement despite the lowest quality scores. Understandability (PEMAT-U) was consistently the strongest positive predictor for both quality (Global Quality Score, final model adjusted R<sup>2</sup>=0.383, β=0.485) and reliability (modified DISCERN, final model adjusted R<sup>2</sup>=0.209, β=0.319). Actionability (PEMAT-A) and video duration were also significant positive predictors. Understandability scores (PEMAT-U) were generally high (approximately 69%), while actionability scores (PEMAT-A) were moderate to low (33%-50%). Sentiment analysis revealed that comments were predominantly neutral (35,372/49,680, 71.2%), with negative comments (9141/49,680, 18.4%) significantly outweighing positive ones (5167/49,680, 10.4%). Key discussion themes identified included sources of knowledge acquisition, sexual safety and prevention, physiology, and sexual health and practices.</p><p><strong>Conclusions: </strong>While online video platforms offer accessible channels for adolescent sexuality education in China, the current content is often of moderate-to-poor quality, with questionable reliability and limited actionability. Understandability is paramount, but high engagement does not necessarily correlate with high quality or reliability, potentially amplifying misinformation. To effectively empower youth, critical steps include enhancing content quality by adhering to evidence-based frameworks like the International Technical Guidance on Sexuality Education; strengthening platform accountability through improved verification and algorithms; and promoting user media literacy. These measures aim to foster a healthier and more equitable future for Chinese adolescents, helping to achieve goals related to sexually transmitted infections and pregnancy prevention and promoting more open societal attitudes toward sexuality.</p>","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":"9 ","pages":"e77100"},"PeriodicalIF":2.0000,"publicationDate":"2025-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12449667/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"JMIR Formative Research","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2196/77100","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0

Abstract

Background: Adolescence is a critical period for lifelong health, which makes access to accurate and comprehensive sexuality education essential. As video platforms become a primary source of information for adolescents, the quality of their content significantly impacts their physical and mental health.

Objective: This study aimed to evaluate the quality, reliability, understandability, and actionability of adolescent sexuality education videos on major Chinese platforms (Bilibili, TikTok or Douyin, and Kwai), analyze associated user comment sentiment and topics, identify predictors of quality and reliability, and provide recommendations.

Methods: A cross-sectional analysis was conducted (April 2025) on the top 100 comprehensively ranked comprehensive sexuality education videos (N=300 total) retrieved from each platform using the keyword ("adolescent sexuality education"). Videos were assessed using the Global Quality Score, modified DISCERN, and Patient Education Materials Assessment Tool (PEMAT-U/A), with interrater reliability assessed via Cohen κ. A corpus of over 49,000 user comments underwent sentiment analysis (fine-tuned RoBERTa) and topic modeling (BERTopic, yielding 29 topics grouped into 6 themes). Statistical analyses included Kruskal-Wallis H tests, Spearman correlations, and stepwise linear regressions (SPSS [version 27.0]; P<.05).

Results: Video quality and reliability were moderate on Bilibili and TikTok but generally poor on Kwai. Content from verified sources (physicians, educators, and institutional media) demonstrated superior quality and stability compared to highly variable content from individual media (the predominant source type, especially on Kwai; 87/100, 87%). Paradoxically, Kwai exhibited the highest user engagement despite the lowest quality scores. Understandability (PEMAT-U) was consistently the strongest positive predictor for both quality (Global Quality Score, final model adjusted R2=0.383, β=0.485) and reliability (modified DISCERN, final model adjusted R2=0.209, β=0.319). Actionability (PEMAT-A) and video duration were also significant positive predictors. Understandability scores (PEMAT-U) were generally high (approximately 69%), while actionability scores (PEMAT-A) were moderate to low (33%-50%). Sentiment analysis revealed that comments were predominantly neutral (35,372/49,680, 71.2%), with negative comments (9141/49,680, 18.4%) significantly outweighing positive ones (5167/49,680, 10.4%). Key discussion themes identified included sources of knowledge acquisition, sexual safety and prevention, physiology, and sexual health and practices.

Conclusions: While online video platforms offer accessible channels for adolescent sexuality education in China, the current content is often of moderate-to-poor quality, with questionable reliability and limited actionability. Understandability is paramount, but high engagement does not necessarily correlate with high quality or reliability, potentially amplifying misinformation. To effectively empower youth, critical steps include enhancing content quality by adhering to evidence-based frameworks like the International Technical Guidance on Sexuality Education; strengthening platform accountability through improved verification and algorithms; and promoting user media literacy. These measures aim to foster a healthier and more equitable future for Chinese adolescents, helping to achieve goals related to sexually transmitted infections and pregnancy prevention and promoting more open societal attitudes toward sexuality.

Abstract Image

Abstract Image

Abstract Image

中国视频平台青少年性教育的质量与可靠性:情感-话题分析与横断面研究
背景:青春期是终身健康的关键时期,因此获得准确和全面的性教育至关重要。随着视频平台成为青少年的主要信息来源,视频内容的质量对青少年的身心健康产生了重大影响。目的:本研究旨在评估中国主要平台(哔哩哔哩、抖音或抖音和桂花)上青少年性教育视频的质量、可靠性、可理解性和可操作性,分析相关的用户评论情绪和话题,识别质量和可靠性的预测因素,并提供建议。方法:于2025年4月对以“青少年性教育”为关键词,从各平台检索综合排名前100位的综合性教育视频(N=300)进行横断面分析。使用全球质量评分、改良的DISCERN和患者教育材料评估工具(PEMAT-U/A)对视频进行评估,并通过Cohen κ评估相互间的可靠性。超过49,000个用户评论的语料库进行了情感分析(微调RoBERTa)和主题建模(BERTopic,产生29个主题,分为6个主题)。统计分析包括Kruskal-Wallis H检验、Spearman相关性和逐步线性回归(SPSS [version 27.0]);结果:Bilibili和TikTok上的视频质量和可靠性一般,但葵上的视频质量和可靠性一般较差。与来自个人媒体(主要来源类型,特别是在Kwai上;87/ 100,87%)的高度可变的内容相比,来自经过验证的来源(医生、教育工作者和机构媒体)的内容表现出更高的质量和稳定性。矛盾的是,尽管质量得分最低,葵却表现出最高的用户参与度。可理解性(PEMAT-U)始终是质量(Global quality Score,最终模型调整R2=0.383, β=0.485)和信度(modified DISCERN,最终模型调整R2=0.209, β=0.319)的最强正向预测因子。可操作性(PEMAT-A)和视频时长也是显著的正向预测因子。可理解性分数(PEMAT-U)一般较高(约69%),而可操作性分数(PEMAT-A)中等至低(33%-50%)。情绪分析显示,评论以中性为主(35,372/49,680,71.2%),负面评论(9141/49,680,18.4%)显著超过正面评论(5167/49,680,10.4%)。确定的主要讨论主题包括获取知识的来源、性安全和预防性、生理学以及性健康和做法。结论:虽然在线视频平台为中国青少年性教育提供了方便的渠道,但目前的内容往往质量中低,可靠性和可操作性都存在问题。可理解性是最重要的,但高粘性不一定与高质量或可靠性相关,这可能会放大错误信息。为有效增强青年权能,关键步骤包括:坚持《国际性教育技术指南》等循证框架,提高内容质量;通过改进验证和算法加强平台问责制;提高用户的媒体素养。这些措施旨在为中国青少年营造一个更健康、更公平的未来,帮助实现与性传播感染和预防怀孕有关的目标,并促进社会对性的更开放的态度。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
JMIR Formative Research
JMIR Formative Research Medicine-Medicine (miscellaneous)
CiteScore
2.70
自引率
9.10%
发文量
579
审稿时长
12 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信