{"title":"A Real-Time Decision Support Tool for Disaster Response: A Mathematical Programming Approach","authors":"Y. Kuo, J. Leung, H. Meng, K. Tsoi","doi":"10.1109/BigDataCongress.2015.98","DOIUrl":"https://doi.org/10.1109/BigDataCongress.2015.98","url":null,"abstract":"Disasters are sudden and calamitous events that can cause severe and pervasive negative impacts on society and huge human losses. Governments and humanitarian organizations have been putting tremendous efforts to avoid and reduce the negative consequences due to disasters. In recent years, information technology and big data have played an important role in disaster management. While there has been much work on disaster information extraction and dissemination, real-time optimization for decision support for disaster response is rarely addressed in big data research. In this paper, we propose a mathematical programming approach, with real-time disaster-related information, to optimize the post-disaster decisions for emergency supplies delivery. This decision support tool can provide rapid and effective solutions, which are essential for disaster response.","PeriodicalId":418995,"journal":{"name":"2015 IEEE International Congress on Big Data","volume":"73 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126718722","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Bin Cheng, Salvatore Longo, Flavio Cirillo, M. Bauer, E. Kovacs
{"title":"Building a Big Data Platform for Smart Cities: Experience and Lessons from Santander","authors":"Bin Cheng, Salvatore Longo, Flavio Cirillo, M. Bauer, E. Kovacs","doi":"10.1109/BigDataCongress.2015.91","DOIUrl":"https://doi.org/10.1109/BigDataCongress.2015.91","url":null,"abstract":"The Internet of Things (IoT) is now shaping our cities to make them more connected, convenient, and intelligent. However, this change will highly rely on extracted values and insights from the big data generated by our cities via sensors, devices, and human activities. Many existing studies and projects have been done to make our cities smart, focusing more on how to deploy various sensors and devices and then collect data from them. However, this is just the first step towards smart cities and next step will be to make good use of the collected data and enable context-awareness and intelligence into all kinds of applications and services via a flexible big data platform. In this paper, we introduce the system architecture and the major design issues of a live City Data and Analytics Platform, namely CiDAP. More importantly, we share our experience and lessons learned from building this practical system for a large scale running smart city test bed, SmartSantander. Our work provides a valuable example to future Smart City platform designers so that they can foresee some practice issues and refer to our solution when building their own smart city data platforms.","PeriodicalId":418995,"journal":{"name":"2015 IEEE International Congress on Big Data","volume":"58 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114168371","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Hussein Mohsen, H. Kurban, K. Zimmer, Mark Jenne, Mehmet M. Dalkilic
{"title":"Red-RF: Reduced Random Forest for Big Data Using Priority Voting & Dynamic Data Reduction","authors":"Hussein Mohsen, H. Kurban, K. Zimmer, Mark Jenne, Mehmet M. Dalkilic","doi":"10.1109/BigDataCongress.2015.26","DOIUrl":"https://doi.org/10.1109/BigDataCongress.2015.26","url":null,"abstract":"Random Forests have been used as effective ensemble models for classification. We present in this paper a new type of Random Forests (RFs) called Red(uced) RF that adopts a new dynamic data reduction principle and a new voting mechanism called Priority Vote Weighting (PV) which improve accuracy, execution time and AUC values compared to Breiman's RF. Red-RF also shows that the strength of a random forest can increase without noticeably increasing correlation between the trees. We then compare performance of Red-RF and Breiman's RF in 8 experiments that involve classification problems with datasets of different sizes. Finally, we conduct 2 additional experiments that involve considerably big datasets with one million points in each.","PeriodicalId":418995,"journal":{"name":"2015 IEEE International Congress on Big Data","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129648214","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Big Data - Security and Privacy","authors":"E. Bertino, E. Ferrari","doi":"10.1007/978-3-319-61893-7_25","DOIUrl":"https://doi.org/10.1007/978-3-319-61893-7_25","url":null,"abstract":"","PeriodicalId":418995,"journal":{"name":"2015 IEEE International Congress on Big Data","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126658561","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Can We Rank Emotions? A Brand Love Ranking System for Emotional Terms","authors":"Andreas Kanavos, E. Kafeza, C. Makris","doi":"10.1109/BigDataCongress.2015.20","DOIUrl":"https://doi.org/10.1109/BigDataCongress.2015.20","url":null,"abstract":"In this paper we examine customers' emotional attachment to a brand name utilizing content extracted from social media. More specifically, we consider the emotions associated to brand love appearing in the form of terms in users' Twitter posts. Building on existing work that identifies seven dimensions in brand love, we propose a probabilistic network scheme that employs a topic identification method so as to identify the aspects of the brand name. In order to address these visible key signs, we find a realistic emotional term ranking that integrates different types of information within the inference network considering the emotional dimensions of terms, their synonyms as well as the current (dynamic) aspects of the brand. Moreover, we introduce a Twitter Behavior Metric that depicts user behavior and we associate brand love to user behavior. The effectiveness of our approach is demonstrated by sampling the Twitter graph on a specific brand and examining the inference network output as well as its relationship with users' behavior metric.","PeriodicalId":418995,"journal":{"name":"2015 IEEE International Congress on Big Data","volume":"43 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123375751","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
U. Raju, Irlanki Sandeep, Nattam Sai Karthik, Rayapudi Siva Praveen, Mayank Sachan
{"title":"Weighted Finite Automata Based Image Compression on Hadoop MapReduce Framework","authors":"U. Raju, Irlanki Sandeep, Nattam Sai Karthik, Rayapudi Siva Praveen, Mayank Sachan","doi":"10.1109/BigDataCongress.2015.101","DOIUrl":"https://doi.org/10.1109/BigDataCongress.2015.101","url":null,"abstract":"In this paper, we explore the algorithm for WFA inference from images, and its possibilities. We also provide a brief introduction into Hadoop and its application in image processing. Hadoop MapReduce framework can be extended to work with WFA based compression of images, as the data set of images is very huge.","PeriodicalId":418995,"journal":{"name":"2015 IEEE International Congress on Big Data","volume":"50 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116490499","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"CoUPE: Continuous Query Processing Engine for Evolving Graphs","authors":"Phani Rohit Mullangi, Lakshmish Ramaswamy","doi":"10.1109/BigDataCongress.2015.29","DOIUrl":"https://doi.org/10.1109/BigDataCongress.2015.29","url":null,"abstract":"Continuously Evolving Graphs (CEGs) are graphs whose connectivity constantly changes over time is uniquely important for many domains such as social networks, evolutionary genomics, communication networks etc. In many of these it is often important to keep track of connectivity among the nodes of interest as the underlying structure changes over time. While interval-based indexing has been a popular strategy for testing reachability in static graphs, it cannot be directly applied in the context of evolving graphs. In this paper, we propose CoUPE (Continuous qUery Processing Engine), which, to our best knowledge, is the first time-efficient framework for answering continuous reachability queries in evolving graphs. The main idea here is to maintain the indices of the evolving graph and recalculate only a subset of reachability queries using a novel heuristic to determine the change in the state of queries because for the most recent change in the graph. We make three novel contributions while designing CoUPE. First, we introduce a generic indexing and querying framework for answering continuous queries in large time-evolving graphs. Second, we design a highly efficient, scalable and provably correct algorithm for updating the indices of graph by analyzing the changes happening on the graph. Third, we present a novel heuristic-based technique for identifying which subset of existing queries might get effected because of the most recent edit. This paper also presents a detailed experimental study demonstrating the scalability and efficiency of the processing engine.","PeriodicalId":418995,"journal":{"name":"2015 IEEE International Congress on Big Data","volume":"1997 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131174134","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Robertus Nugroho, Jian Yang, Youliang Zhong, Cécile Paris, S. Nepal
{"title":"Deriving Topics in Twitter by Exploiting Tweet Interactions","authors":"Robertus Nugroho, Jian Yang, Youliang Zhong, Cécile Paris, S. Nepal","doi":"10.1109/BigDataCongress.2015.22","DOIUrl":"https://doi.org/10.1109/BigDataCongress.2015.22","url":null,"abstract":"Twitter as a big data social network becomes one of the most important sources for capturing the up-to-date events happening in the world. Topic derivation from Twitter is important for various applications such as situation awareness, market analysis, content filtering, and recommendations. However, tweets are short messages, which makes topic derivation challenging. Current methods employ various semantic features of tweet content but mostly overlook the interactions among tweets. In this paper, we propose a novel topic derivation method that takes into account the interactions among tweets, defined as the reciprocal activities related to people who send the tweets, as well as actions and tweet contents. In particular, topics are derived by performing a two-step matrix factorization jointly over the interactions and semantic features of the tweets. We have conducted a number of experiments on tweets collected over a period of time, showing that the proposed method consistently outperforms other advanced topic derivation methods in the literature. Our experiments also reveal that the interactions among tweets do significantly relieve the sparsity problem caused by the short-text nature of Twitter.","PeriodicalId":418995,"journal":{"name":"2015 IEEE International Congress on Big Data","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130984581","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Flexible Data-Driven Approach for Execution Trace Filtering","authors":"K. Kouame, Naser Ezzati-Jivan, M. Dagenais","doi":"10.1109/BigDataCongress.2015.112","DOIUrl":"https://doi.org/10.1109/BigDataCongress.2015.112","url":null,"abstract":"Execution traces are frequently used to study system run-time behavior and to detect problems. However, the huge amount of data in an execution trace may complexify its analysis. Moreover, users are not usually interested in all events of a trace, hence the need for a proper filtering approach. Filtering is used to generate an enhanced trace, with a reduced size and complexity, that is easier to analyse. The approach described in this paper allows to define custom filtering patterns, declaratively in XML, to concentrate the analysis on the most important and interesting events. The filtering scenarios include syntaxes to describe various analysis patterns using finite state machines. The patterns range from very simple event filtering to complex multi-level event abstraction, covering various types of synthetic behaviours that can be captured from execution trace data. The paper provides the details on this data-driven filtering approach and some interesting use cases for the trace events generated by the LTTng Linux kernel tracer.","PeriodicalId":418995,"journal":{"name":"2015 IEEE International Congress on Big Data","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114973868","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Workflow Model for Adaptive Analytics on Big Data","authors":"Verena Kantere, M. Filatov","doi":"10.1109/BigDataCongress.2015.106","DOIUrl":"https://doi.org/10.1109/BigDataCongress.2015.106","url":null,"abstract":"The analysis of Big Data needs to be performed on a range of data stores, both traditional and modern, on data sources that are heterogeneous in their schemas and formats, and on a diversity of query engines. The users that need to perform such data analysis may have several roles, like, business analysts, engineers, end-users etc. Therefore Big Data analytics should be expressed and executed in a manner that is adaptive to the user and the system. We discuss the principles of adaptive analytics and we summarise ongoing work on the creation of a workflow model and, furthermore, a workflow management system that enables the creation and the execution of adaptive analytics. The model focuses on the separation of task dependencies from task functionality and the decoupling of application logic from implementation. Our motivation and applications derive from real use cases of the telecommunication domain.","PeriodicalId":418995,"journal":{"name":"2015 IEEE International Congress on Big Data","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116796567","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}