Towards Extract-Transform-Load Operations in a Big Data context

Int. J. Sociotechnology Knowl. Dev. Pub Date : 2020-04-01 DOI:10.4018/ijskd.2020040105

Hana Mallek, Faïza Ghozzi, F. Gargouri

{"title":"Towards Extract-Transform-Load Operations in a Big Data context","authors":"Hana Mallek, Faïza Ghozzi, F. Gargouri","doi":"10.4018/ijskd.2020040105","DOIUrl":null,"url":null,"abstract":"BigDataemergedafterabigexplosionofdatafromtheWeb2.0,digitalsensors,andsocialmedia applications such as Facebook, Twitter, etc. In this constant growth of data, many domains are influenced, especially thedecisional support systemdomain,where the integrationof processes shouldbeadaptedtosupportthishugeamountofdatatoimproveanalysisgoals.Thebasicpurpose ofthisresearcharticleistoadaptextract-transform-loadprocesseswithBigDatatechnologies,in order tosupportnotonlythisevolutionofdatabutalsotheknowledgediscovery.Inthisarticle, anewapproachcalledBigDimensionalETL(BigDimETL)issuggestedtodealwithETLbasic operationsandtakeintoaccountthemultidimensionalstructure.Inordertoacceleratedatahandling, theMapReduceparadigmisusedtoenhancedatawarehousingcapabilitiesandHBaseasadistributed storagemechanism.ExperimentalresultsconfirmthattheETLoperationperformswellespecially withadaptedoperations. KEywORDS Big Data, ETL, Hbase, Map Reduce, Multidimensional Structure","PeriodicalId":13656,"journal":{"name":"Int. J. Sociotechnology Knowl. Dev.","volume":"96 1","pages":"77-95"},"PeriodicalIF":0.0000,"publicationDate":"2020-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"10","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Int. J. Sociotechnology Knowl. Dev.","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.4018/ijskd.2020040105","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 10

Abstract

BigDataemergedafterabigexplosionofdatafromtheWeb2.0,digitalsensors,andsocialmedia applications such as Facebook, Twitter, etc. In this constant growth of data, many domains are influenced, especially thedecisional support systemdomain,where the integrationof processes shouldbeadaptedtosupportthishugeamountofdatatoimproveanalysisgoals.Thebasicpurpose ofthisresearcharticleistoadaptextract-transform-loadprocesseswithBigDatatechnologies,in order tosupportnotonlythisevolutionofdatabutalsotheknowledgediscovery.Inthisarticle, anewapproachcalledBigDimensionalETL(BigDimETL)issuggestedtodealwithETLbasic operationsandtakeintoaccountthemultidimensionalstructure.Inordertoacceleratedatahandling, theMapReduceparadigmisusedtoenhancedatawarehousingcapabilitiesandHBaseasadistributed storagemechanism.ExperimentalresultsconfirmthattheETLoperationperformswellespecially withadaptedoperations. KEywORDS Big Data, ETL, Hbase, Map Reduce, Multidimensional Structure

查看原文本刊更多论文

面向大数据环境下的提取-转换-加载操作

BigDataemergedafterabigexplosionofdatafromtheWeb2.0，digitalsensors，andsocialmedia应用程序，如Facebook, Twitter等，在数据的不断增长中，许多领域都受到了影响，特别是thedecisional supportsystemdomain，where theintegrationof processesshouldbeadaptedtosupportthishugeamountofdatatoimproveanalysisgoals。Thebasicpurpose ofthisresearcharticleistoadaptextract-transform-loadprocesseswithBigDatatechnologies，in order_ tosupportnotonlythisevolutionofdatabutalsotheknowledgediscovery。Inthisarticle, anewapproachcalledBigDimensionalETL(BigDimETL)issuggestedtodealwithETLbasic operationsandtakeintoaccountthemultidimensionalstructure。Inordertoacceleratedatahandling, theMapReduceparadigmisusedtoenhancedatawarehousingcapabilitiesandHBaseasadistributed storagemechanism。ExperimentalresultsconfirmthattheETLoperationperformswellespecially withadaptedoperations。关键词:大数据，ETL, Hbase, Map Reduce，多维结构

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Int. J. Sociotechnology Knowl. Dev.

自引率

0.00%

发文量