丰富的nlp自动视频分割

Mohannad AlMousa, R. Benlamri, R. Khoury
{"title":"丰富的nlp自动视频分割","authors":"Mohannad AlMousa, R. Benlamri, R. Khoury","doi":"10.1109/ICMCS.2018.8525880","DOIUrl":null,"url":null,"abstract":"E-learning environments are heavily dependent on videos as the main media to deliver lectures to learners. Despite the merits of video-based lectures, new challenges can paralyze the learning process. Challenges that deal with video content accessibility, such as searching, retrieving, explaining, matching, organizing, and even summarizing these contents, significantly limit the potential of video-based learning. In this paper, we propose a novel approach to segment video lectures and integrate Natural Language Processing (NLP) tasks to extract key linguistic features exist within the video. We exploit the benefits of visual, audio, and textual features in order to create comprehensive temporal feature vectors for the enhanced segmented video. Afterwards, we apply an NLP cosine similarity to the cluster and identify the various topics presented in the video. The final product would be an indexed, vector-based searchable video segments of a specific topic/subtopic","PeriodicalId":272255,"journal":{"name":"2018 6th International Conference on Multimedia Computing and Systems (ICMCS)","volume":"99 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-05-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"NLP-Enriched Automatic Video Segmentation\",\"authors\":\"Mohannad AlMousa, R. Benlamri, R. Khoury\",\"doi\":\"10.1109/ICMCS.2018.8525880\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"E-learning environments are heavily dependent on videos as the main media to deliver lectures to learners. Despite the merits of video-based lectures, new challenges can paralyze the learning process. Challenges that deal with video content accessibility, such as searching, retrieving, explaining, matching, organizing, and even summarizing these contents, significantly limit the potential of video-based learning. In this paper, we propose a novel approach to segment video lectures and integrate Natural Language Processing (NLP) tasks to extract key linguistic features exist within the video. We exploit the benefits of visual, audio, and textual features in order to create comprehensive temporal feature vectors for the enhanced segmented video. Afterwards, we apply an NLP cosine similarity to the cluster and identify the various topics presented in the video. The final product would be an indexed, vector-based searchable video segments of a specific topic/subtopic\",\"PeriodicalId\":272255,\"journal\":{\"name\":\"2018 6th International Conference on Multimedia Computing and Systems (ICMCS)\",\"volume\":\"99 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2018-05-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2018 6th International Conference on Multimedia Computing and Systems (ICMCS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICMCS.2018.8525880\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2018 6th International Conference on Multimedia Computing and Systems (ICMCS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICMCS.2018.8525880","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 4

摘要

电子学习环境严重依赖视频作为向学习者传授课程的主要媒体。尽管视频授课有很多优点,但新的挑战可能会使学习过程陷入瘫痪。处理视频内容可访问性的挑战,如搜索、检索、解释、匹配、组织甚至总结这些内容,极大地限制了基于视频的学习的潜力。在本文中,我们提出了一种新的方法来分割视频讲座,并整合自然语言处理(NLP)任务来提取视频中存在的关键语言特征。我们利用视觉、音频和文本特征的优势,为增强的分段视频创建全面的时间特征向量。之后,我们对聚类应用NLP余弦相似性,并识别视频中呈现的各种主题。最终产品将是一个索引的,基于矢量的可搜索视频片段的特定主题/子主题
本文章由计算机程序翻译,如有差异,请以英文原文为准。
NLP-Enriched Automatic Video Segmentation
E-learning environments are heavily dependent on videos as the main media to deliver lectures to learners. Despite the merits of video-based lectures, new challenges can paralyze the learning process. Challenges that deal with video content accessibility, such as searching, retrieving, explaining, matching, organizing, and even summarizing these contents, significantly limit the potential of video-based learning. In this paper, we propose a novel approach to segment video lectures and integrate Natural Language Processing (NLP) tasks to extract key linguistic features exist within the video. We exploit the benefits of visual, audio, and textual features in order to create comprehensive temporal feature vectors for the enhanced segmented video. Afterwards, we apply an NLP cosine similarity to the cluster and identify the various topics presented in the video. The final product would be an indexed, vector-based searchable video segments of a specific topic/subtopic
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信