Building the Tower of Babel for Big Data

Abstract

Big data are sets of information that are too large or complex to process by traditional means. Finding results that determine trends is like finding a needle in a haystack. The field of big data is constantly changing, as a result, new methods and techniques are being developed. One such area that has not received substantial attention is a comprehensive guide on how to build a system that can handle big data using deep learning. Big data has gained great traction and support, due to it being a method to discover new trends with machine learning and artificial intelligence. This guide provides some high level design considerations to build an integrated big data system for a theoretical ship that uses prognostics to determine Remaining Useful Life (RUL) of components.