Design and implementation of the network video data acquisition system

2016 7th IEEE International Conference on Software Engineering and Service Science (ICSESS) Pub Date : 2016-08-01 DOI:10.1109/ICSESS.2016.7883121

Feifei Guo, Yu Liang

{"title":"Design and implementation of the network video data acquisition system","authors":"Feifei Guo, Yu Liang","doi":"10.1109/ICSESS.2016.7883121","DOIUrl":null,"url":null,"abstract":"Big data technology plays a role in promoting the development of Internet video, and data has become an important carrier for users and network video platform to dig the effect of video communication, guide the video production, and master the user's behavior habits. This system establishes the conceptual process from data acquisition, data processing, data visualization. This article makes analysis and research from the following aspects: the URL extraction module, data acquisition module, data processing module, data visualization module and other functions. For the front page, the system adopts HTML+CSS+JavaScript, for data acquisition core module, the system uses DOM to operate the HTML page node to complete data crawling, and uses MVC architecture of CodeIgniter combined with Ajax technology to achieve the separation between the logical layer data acquisition program and application layer access page . For data visualization, Highcharts is used to display the data so that the data has a better interactivity and presentation capabilities.","PeriodicalId":175933,"journal":{"name":"2016 7th IEEE International Conference on Software Engineering and Service Science (ICSESS)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2016 7th IEEE International Conference on Software Engineering and Service Science (ICSESS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICSESS.2016.7883121","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 1

Abstract

Big data technology plays a role in promoting the development of Internet video, and data has become an important carrier for users and network video platform to dig the effect of video communication, guide the video production, and master the user's behavior habits. This system establishes the conceptual process from data acquisition, data processing, data visualization. This article makes analysis and research from the following aspects: the URL extraction module, data acquisition module, data processing module, data visualization module and other functions. For the front page, the system adopts HTML+CSS+JavaScript, for data acquisition core module, the system uses DOM to operate the HTML page node to complete data crawling, and uses MVC architecture of CodeIgniter combined with Ajax technology to achieve the separation between the logical layer data acquisition program and application layer access page . For data visualization, Highcharts is used to display the data so that the data has a better interactivity and presentation capabilities.

查看原文本刊更多论文

网络视频数据采集系统的设计与实现

大数据技术对互联网视频的发展起到了推动作用，数据已经成为用户和网络视频平台挖掘视频传播效果、指导视频制作、掌握用户行为习惯的重要载体。该系统建立了从数据采集、数据处理、数据可视化的概念流程。本文从以下几个方面进行分析和研究:URL提取模块、数据采集模块、数据处理模块、数据可视化模块等功能。对于首页，系统采用HTML+CSS+JavaScript，对于数据采集核心模块，系统采用DOM操作HTML页面节点完成数据抓取，采用CodeIgniter的MVC架构结合Ajax技术实现逻辑层数据采集程序与应用层访问页面的分离。对于数据可视化，Highcharts用于显示数据，以便数据具有更好的交互性和表示功能。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

2016 7th IEEE International Conference on Software Engineering and Service Science (ICSESS)

自引率

0.00%

发文量