{"title":"基于时间戳的高效增量同步方法的研究与实现","authors":"Yueren Sun","doi":"10.1109/cniot55862.2022.00035","DOIUrl":null,"url":null,"abstract":"With the application of information management system, enterprises build many independent databases to meet different business needs. In order to mine information from multi-source data, data needs to be extracted to a specified data warehouse. This can be accomplished through ETL(extract-transformation-loading), Among them, data extraction is a key stage in ETL. After comparing the advantages and disadvantages of various incremental data extraction mechanisms, this paper proposes a time-stamp-based incremental synchronization scheme, which can not only improve the extraction efficiency, but also solve the shortcoming that the time-stamp extraction method cannot capture deleted data.","PeriodicalId":251734,"journal":{"name":"2022 3rd International Conference on Computing, Networks and Internet of Things (CNIOT)","volume":"10 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Research and implementation of an efficient incremental synchronization method based on Timestamp\",\"authors\":\"Yueren Sun\",\"doi\":\"10.1109/cniot55862.2022.00035\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"With the application of information management system, enterprises build many independent databases to meet different business needs. In order to mine information from multi-source data, data needs to be extracted to a specified data warehouse. This can be accomplished through ETL(extract-transformation-loading), Among them, data extraction is a key stage in ETL. After comparing the advantages and disadvantages of various incremental data extraction mechanisms, this paper proposes a time-stamp-based incremental synchronization scheme, which can not only improve the extraction efficiency, but also solve the shortcoming that the time-stamp extraction method cannot capture deleted data.\",\"PeriodicalId\":251734,\"journal\":{\"name\":\"2022 3rd International Conference on Computing, Networks and Internet of Things (CNIOT)\",\"volume\":\"10 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 3rd International Conference on Computing, Networks and Internet of Things (CNIOT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/cniot55862.2022.00035\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 3rd International Conference on Computing, Networks and Internet of Things (CNIOT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/cniot55862.2022.00035","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Research and implementation of an efficient incremental synchronization method based on Timestamp
With the application of information management system, enterprises build many independent databases to meet different business needs. In order to mine information from multi-source data, data needs to be extracted to a specified data warehouse. This can be accomplished through ETL(extract-transformation-loading), Among them, data extraction is a key stage in ETL. After comparing the advantages and disadvantages of various incremental data extraction mechanisms, this paper proposes a time-stamp-based incremental synchronization scheme, which can not only improve the extraction efficiency, but also solve the shortcoming that the time-stamp extraction method cannot capture deleted data.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
