Data Mining and Data Warehousing最新文献

筛选
英文 中文
Beginning with Weka and R Language 从Weka和R语言开始
Data Mining and Data Warehousing Pub Date : 2019-05-01 DOI: 10.1017/9781108635592.004
Parteek Bhatia
{"title":"Beginning with Weka and R Language","authors":"Parteek Bhatia","doi":"10.1017/9781108635592.004","DOIUrl":"https://doi.org/10.1017/9781108635592.004","url":null,"abstract":"Chapter Objectives ✓ To learn to install Weka and the R language ✓ To demonstrate the use of Weka software ✓ To experiment with Weka on the Iris dataset ✓ To introduce basics of R language ✓ To experiment with R on the Iris dataset About Weka In this book, all data mining algorithms are explained with Weka and R language. The learner can perform and apply these algorithms easily using these well-know data mining tool and language. Let's first discuss the Weka tool. Weka is an open-source software under the GNU General Public License System. It was developed by the Machine Learning Group, University of Waikato, New Zealand. Although named after a flightless New Zealand bird, ‘WEKA’ stands for Waikato Environment for Knowledge Analysis. The system is written using the object oriented language Java. Weka is data mining software and it is a set of machine learning algorithms that can be applied to a dataset directly, or called from your own Java code. Weka contains tools for data pre-processing, classification, regression, clustering, association rules, and visualization. The story of the development of Weka is very interesting. It was initially developed by students of University of Waikato, New Zealand, as part of their course work on data mining. They had implemented all major machine learning algorithms as part of lab work for this course. In 1993, the University of Waikato began development of the original version of Weka, which became a mix of Tcl/Tk, C, and Makefiles. In 1997, the decision was made to redevelop Weka from scratch in Java, including implementations of modeling algorithms. In 2006, Pentaho Corporation acquired an exclusive license to use Weka for business intelligence. This chapter will cover the installation of Weka, datasets available and will guide the learner about how to start experimentation using Weka. Later on we will discuss another data mining tool, R. Let us first discuss the installation process for Weka, step-by-step. Installing Weka Weka is freely available and its latest version can be easily downloaded from https://www.cs.waikato. ac.nz/ml/weka/downloading.html as shown in Figure 3.1. To work more smoothly, you must first download and install Java VM before downloading Weka.","PeriodicalId":180145,"journal":{"name":"Data Mining and Data Warehousing","volume":"283 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132024060","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Implementing Classification in Weka and R 在Weka和R中实现分类
Data Mining and Data Warehousing Pub Date : 2019-05-01 DOI: 10.1017/9781108635592.007
Parteek Bhatia
{"title":"Implementing Classification in Weka and R","authors":"Parteek Bhatia","doi":"10.1017/9781108635592.007","DOIUrl":"https://doi.org/10.1017/9781108635592.007","url":null,"abstract":"Chapter Objectives ✓ To demonstrate the use of the decision tree ✓ To apply the decision tree on a sample dataset ✓ To implement a decision tree process using Weka and R Building a Decision Tree Classifier in Weka In this chapter, we will learn how Weka's decision tree feature helps to classify unknown samples of a dataset based on its attribute values. When Weka's decision tree is applied to an unknown sample, the decision tree classifies the sample into different classes such as Class A, Class B and Class C as shown in Figure 6.1. For example, if we want to predict the class of an unknown sample of a flower based on the length and width dimensions of its Sepal and Petal. The first step would be to measure Sepal length and width and Petal length and width of an unknown flower and compare these dimensions to the values of the samples in our dataset of known species. The decision tree algorithm of Weka will help in creating decision rules to predict the class of unknown flower automatically as shown in Figure 6.2. As shown in Figure 6.2, the dimensions of an unknown sample of flower will be matched with the rules generated by the decision tree. First, the rules will be matched to determine whether the sample belongs to Setosa class or not, if yes, the unknown sample will be classified as setosa. If not, the unknown sample will be checked for being of the Virginica class. If it matches with the conditions of the Virginica class, it will be labeled as Virginica, otherwise Versicolor. It is important to note that it would not be simple to create these rules on the basis of the values of single attribute as shown in Table 6.1. It is clear that for the same Sepal width, the flower may be of Setosa or Versicolor or Virginica, making it unclear which species an unknown flower belongs to on the basis of Sepal width alone. Thus, the decision tree must make its prediction based on all four flower dimensions. Due to such overlaps, the decision tree cannot predict with 100% accuracy the class of flower, but can only determine the likelihood of an unknown sample belonging to a particular class. In real situations the decision tree algorithm works on the basis of probability.","PeriodicalId":180145,"journal":{"name":"Data Mining and Data Warehousing","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123707726","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Implementing Clustering with Weka and R 用Weka和R实现集群
Data Mining and Data Warehousing Pub Date : 2019-05-01 DOI: 10.1017/9781108635592.009
Parteek Bhatia
{"title":"Implementing Clustering with Weka and R","authors":"Parteek Bhatia","doi":"10.1017/9781108635592.009","DOIUrl":"https://doi.org/10.1017/9781108635592.009","url":null,"abstract":"Chapter Objectives ✓ To apply the K-means algorithm in Weka and R language ✓ To interpret the results of clustering ✓ To identify the optimum number of clusters ✓ To apply classification on un-labeled data by using clustering as an intermediate step Introduction As discussed earlier, if data is not labeled then we can analyze this data by performing a clustering analysis, where clustering refers to the task of grouping a set of objects into classes of similar objects. In this chapter, we will apply clustering on Fisher's Iris dataset. We will use clustering algorithms to group flower samples into clusters with similar flower dimensions. These clusters then become possible ways to group flowers samples into species. We will implement a simple k-means algorithm to cluster numerical attributes with the help of Weka and R. In the case of classification, we know the attributes and classes of instances. For example, the flower dimensions and classes were already known to us for the Iris dataset. Our goal was to predict the class of an unknown sample as shown in Figure 8.1. Earlier, we used the Weka J48 classification algorithm to build a decision tree on Fisher's Iris dataset using samples with known class, which helped in predicting the class of unknown samples. We used the flower's Sepal length and width, and the Petal length and width as the specific attributes for this. Based on flower dimensions and using this tree, we can identify an unknown Iris as one of three species, Setosa, Versicolor, and Virginica. In clustering, we know the attributes for the instances, but we don't know the classes. For example, we know the flower dimensions for samples of the Iris dataset but we don't know what classes exist as shown in Figure 8.2. Therefore, our goal is to group instances into clusters with similar attributes or dimensions and then identify the class. In this chapter, we will learn what happens if we don't know what classes the samples belong to, or even how many classes there are, or even what defines a class? Since, Fisher's Iris dataset is already labeled, we will first make this dataset unlabeled by removing the class attribute, i.e., the species column. Then, we will apply clustering algorithms to cluster this data on the basis of its input attributes, i.e., Sepal length, Sepal width, Petal length, and Petal width.","PeriodicalId":180145,"journal":{"name":"Data Mining and Data Warehousing","volume":"111 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133511998","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Beginning with Machine Learning 从机器学习开始
Data Mining and Data Warehousing Pub Date : 2019-05-01 DOI: 10.1017/9781108635592.002
Parteek Bhatia
{"title":"Beginning with Machine Learning","authors":"Parteek Bhatia","doi":"10.1017/9781108635592.002","DOIUrl":"https://doi.org/10.1017/9781108635592.002","url":null,"abstract":"Chapter Objectives ✓ To understand the concept of machine learning and its applications. ✓ To understand what are supervised and unsupervised machine learning strategies. ✓ To understand the concept of regression and classification. ✓ To identify the strategy to be applied to a given problem. Introduction to Machine Learning Machine Learning (ML) has emerged as the most extensively used tool for web-sites to classify surfers and address them appropriately. When we surf the Net, we are exposed to machine learning algorithms multiple times a day, often without realizing it. Machine learning is used by search engines such as Google and Bing to rank web pages or to decide which advertisement to show to which user. It is used by social networks such as Facebook and Instagram to generate a custom feed for every user or to tag the user by the picture that was uploaded. It is also used by banks to detect whether an online transaction is genuine or fraudulent and by e-commerce websites such as Amazon and Flipkart to recommend products that we are most likely to buy. Even email providers such as Gmail, Yahoo, and Hotmail use machine learning to decide which emails are spam and which are not. These are only a few examples of applications of machine learning. The ultimate aim of machine learning is to build an Artificial Intelligence (AI) platform that is as intelligent as the human mind. We are not very far from this dream and many AI researchers believe that this goal can be achieved through machine learning algorithms that try to mimic the learning processes of a human brain. Actually, ML is a branch of AI. Many years ago researchers tried to build intelligent programs with pre-defined rules like in the case of a normal program. But this approach did not work as there were too many special cases to be considered. For instance, we can define rules to find the shortest path between two points. But it is very difficult to make rules for programs such as photo tagging, classifying emails as spam or not spam, and web page ranking. The only solution to accomplish these tasks was to write a program that could generate its own rules by examining some examples (also called training data). This approach was named Machine Learning. This book will cover state of art machine learning algorithms and their deployment.","PeriodicalId":180145,"journal":{"name":"Data Mining and Data Warehousing","volume":" 19","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"113950556","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Big Data and NoSQL 大数据和NoSQL
Data Mining and Data Warehousing Pub Date : 2019-04-30 DOI: 10.1017/9781108635592.016
{"title":"Big Data and NoSQL","authors":"","doi":"10.1017/9781108635592.016","DOIUrl":"https://doi.org/10.1017/9781108635592.016","url":null,"abstract":"","PeriodicalId":180145,"journal":{"name":"Data Mining and Data Warehousing","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122564168","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Data Warehouse 数据仓库
Data Mining and Data Warehousing Pub Date : 2019-04-30 DOI: 10.1017/9781108635592.013
Paulo Sérgio Henrique dos Santos
{"title":"Data Warehouse","authors":"Paulo Sérgio Henrique dos Santos","doi":"10.1017/9781108635592.013","DOIUrl":"https://doi.org/10.1017/9781108635592.013","url":null,"abstract":"The proposal of this work is to introduce a Data Warehouse(DW) and a prototype of an online system to help the government of Minas Gerais in the fight against the Zika Virus epidemic, employing the main concepts of this technology. Even though Zika virus infection is a disease with symptoms milder than those of dengue, according to the Ministry of Health (MH), it may cause some complications such as the development of microcephaly in babies, and other complications such as Guillain-Barré Syndrome, which is a neurological disease, and therefore, it requires actions that bring a higher efficacy to the fight against it. From this need emerges the idea of a Data Warehouse(DW) solution, integrating and consolidating the data available in different systems, with the purpose of identifying and analyzing the settings that will make a more successful decision-making process possible. Therefore, the perspective of a higher agility in the communication between laboratories and hospitals performing the diagnosis and the competent organs, as well as in the analyses performed to support actions against Zika Virus epidemic, consist in the main motivation to implement a DW. For this purpose, an exploratory research was performed, with a bibliographic research technique (secondary sources), using Inmon (1999) and Kimbal (1998) concepts, two references in the subject, as well as a DW projects methodology by Barbieri (2001). Documents research (primary sources) was based in the Informe Epidemiológico da Zika Vírus (Zika Virus Epidemiological Report), provided by the State’s Department of Health of Minas Gerais (SES-MG) in its website. In response, then, an online system prototype was developed in this study, with its main functions, and showed to be an effective solution for the purposes it is intended to. Therefore, it may be concluded that DW may improve the efficacy and quality in the decision-making process for the fight against Zika Virus threat in Minas Gerais.","PeriodicalId":180145,"journal":{"name":"Data Mining and Data Warehousing","volume":"81 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126237855","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Data Preprocessing 数据预处理
Data Mining and Data Warehousing Pub Date : 2019-04-30 DOI: 10.1017/9781108635592.005
{"title":"Data Preprocessing","authors":"","doi":"10.1017/9781108635592.005","DOIUrl":"https://doi.org/10.1017/9781108635592.005","url":null,"abstract":"","PeriodicalId":180145,"journal":{"name":"Data Mining and Data Warehousing","volume":"50 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124796005","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Web Mining and Search Engines 网络挖掘和搜索引擎
Data Mining and Data Warehousing Pub Date : 2019-04-30 DOI: 10.1017/9781108635592.012
{"title":"Web Mining and Search Engines","authors":"","doi":"10.1017/9781108635592.012","DOIUrl":"https://doi.org/10.1017/9781108635592.012","url":null,"abstract":"","PeriodicalId":180145,"journal":{"name":"Data Mining and Data Warehousing","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130971773","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Online Analytical Processing 在线分析处理
Data Mining and Data Warehousing Pub Date : 2019-04-30 DOI: 10.1017/9781108635592.015
Wina Witanti, F. Renaldi
{"title":"Online Analytical Processing","authors":"Wina Witanti, F. Renaldi","doi":"10.1017/9781108635592.015","DOIUrl":"https://doi.org/10.1017/9781108635592.015","url":null,"abstract":"Abstrak— Executive Information System (EIS) adalah sebuah konsep untuk menyajikan informasi yang berasal dari data dalam jumlah besar pada sebuah organisasi agar menjadi informasi yang berguna dan sesuai dengan kebutuhan pengguna. Online Analytical Processing (OLAP) dapat melakukan penyaringan data dengan memberikan perintah query dan mengubahnya menjadi informasi yang sesuai dengan kebutuhan. EIS dapat memudahkan manajemen eksekutif perguruan tinggi untuk mendapatkan informasi akademik mahasiswa yang dibutuhkan secara efektif dan efisien tanpa harus melakukan analisis data agar menjadi sebuah informasi.","PeriodicalId":180145,"journal":{"name":"Data Mining and Data Warehousing","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124433620","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Implementing Association Mining with Weka and R 用Weka和R实现关联挖掘
Data Mining and Data Warehousing Pub Date : 2019-04-30 DOI: 10.1017/9781108635592.011
{"title":"Implementing Association Mining with Weka and R","authors":"","doi":"10.1017/9781108635592.011","DOIUrl":"https://doi.org/10.1017/9781108635592.011","url":null,"abstract":"","PeriodicalId":180145,"journal":{"name":"Data Mining and Data Warehousing","volume":"31 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121590198","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书