Cloud Based Information Retrieval Device for Augmentation of Real Time Images

Abstract

This discussion aims at introducing an electronic device with a transparent display screen put to the specific use-case of augmenting real-world images. This can be very useful for an individual who wants to extract reliable information with efficiency and ease. There has been extensive research on transparent devices over the past few years. A transparent device may contain two layers-one for information extraction from surroundings and another one for display. In some cases, a single layer may be able to serve both the purposes. The following section discusses in detail the information extraction/display features exhibited by the device. The idea is to capture the documents which consist of images, handwritten text, maps and mathematical and chemical equations. Using scanning technology or 360-degree camera, we are able to capture the documents. The present invention determines the real time text/ images from the documents and understands them. By the image recognition technique, features like words, formulae, real numbers, shapes of diagrams/ maps etc. are extracted collectively from the images. The data thus extracted is analyzed using Natural Language Processing and Machine learning techniques and matched with the key results in the cloud, as a result giving more insights to the text or diagram. The cloud search typically includes the latest data from the APIs such as wolfram alpha, Wikipedia, articles, current affairs etc., as a result, our final solutions to any query are detailed and will relate to the context and meaning. Our novel device primarily aims to teach students in a digitized way by providing summarizations and helping them understand the logical flow by providing an enhanced solution with steps involved.