Research on Media Data Analysis System Based on Big Data Technology

Abstract

The system designed in the paper uses the method of collecting Twitter tweets to test the collection system. The specific collection content is tweet collection based on keywords, testing the collection rate of tweets and system stability. In the test, the bandwidth of each collection node is limited by using bandwidth limiting software to simulate different network agent environments. The collection system in different environments is tested by changing the collection task and the bandwidth limit of each collection node. The results prove that the algorithm proposed in the paper can significantly improve the evaluation accuracy of media data, and has a significant effect on analyzing the collected objects.