{"title":"面向数据湖的大数据架构:系统文献综述","authors":"Sonam Ramchand, Tariq Mahmood","doi":"10.1109/COMPSAC54236.2022.00179","DOIUrl":null,"url":null,"abstract":"The rise in big technologies has been demanding different concepts and practices for data exploitation; among them data lake is a recently emerged concept that is meant to deal with the heterogeneous data. Data lakes have been residing in the big data era since 2010, but there has not been any systematic review yet over data lake implementation. In this research survey, we conduct a review and provide a road map to researcher that elaborates what has happened to data lakes till now. We aim to give understanding for basic concept of data lakes and propose a novel data lake definition that could best describe the concept based on the literature review. One of the main problem while implementing data lake is deciding the technologies to use, this study covers technologies that can potentially be used for data lake implementation. Furthermore, data lake architectures and their variants are discussed in detail. Moreover, we analyze current state, challenges, pros and cons of the data lake. This study is all in one place for researchers who try to understand data lake concept, architectures, technologies, approaches, current state and challenges.","PeriodicalId":330838,"journal":{"name":"2022 IEEE 46th Annual Computers, Software, and Applications Conference (COMPSAC)","volume":"14 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"Big data architectures for data lakes: A systematic literature review\",\"authors\":\"Sonam Ramchand, Tariq Mahmood\",\"doi\":\"10.1109/COMPSAC54236.2022.00179\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The rise in big technologies has been demanding different concepts and practices for data exploitation; among them data lake is a recently emerged concept that is meant to deal with the heterogeneous data. Data lakes have been residing in the big data era since 2010, but there has not been any systematic review yet over data lake implementation. In this research survey, we conduct a review and provide a road map to researcher that elaborates what has happened to data lakes till now. We aim to give understanding for basic concept of data lakes and propose a novel data lake definition that could best describe the concept based on the literature review. One of the main problem while implementing data lake is deciding the technologies to use, this study covers technologies that can potentially be used for data lake implementation. Furthermore, data lake architectures and their variants are discussed in detail. Moreover, we analyze current state, challenges, pros and cons of the data lake. This study is all in one place for researchers who try to understand data lake concept, architectures, technologies, approaches, current state and challenges.\",\"PeriodicalId\":330838,\"journal\":{\"name\":\"2022 IEEE 46th Annual Computers, Software, and Applications Conference (COMPSAC)\",\"volume\":\"14 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 IEEE 46th Annual Computers, Software, and Applications Conference (COMPSAC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/COMPSAC54236.2022.00179\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE 46th Annual Computers, Software, and Applications Conference (COMPSAC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/COMPSAC54236.2022.00179","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Big data architectures for data lakes: A systematic literature review
The rise in big technologies has been demanding different concepts and practices for data exploitation; among them data lake is a recently emerged concept that is meant to deal with the heterogeneous data. Data lakes have been residing in the big data era since 2010, but there has not been any systematic review yet over data lake implementation. In this research survey, we conduct a review and provide a road map to researcher that elaborates what has happened to data lakes till now. We aim to give understanding for basic concept of data lakes and propose a novel data lake definition that could best describe the concept based on the literature review. One of the main problem while implementing data lake is deciding the technologies to use, this study covers technologies that can potentially be used for data lake implementation. Furthermore, data lake architectures and their variants are discussed in detail. Moreover, we analyze current state, challenges, pros and cons of the data lake. This study is all in one place for researchers who try to understand data lake concept, architectures, technologies, approaches, current state and challenges.