Proceedings of the twenty-first international conference on Machine learning最新文献

筛选
英文 中文
Boosting grammatical inference with confidence oracles 用自信的神谕促进语法推理
Proceedings of the twenty-first international conference on Machine learning Pub Date : 2004-07-04 DOI: 10.1145/1015330.1015336
J. Janodet, R. Nock, M. Sebban, Henri-Maxime Suchier
{"title":"Boosting grammatical inference with confidence oracles","authors":"J. Janodet, R. Nock, M. Sebban, Henri-Maxime Suchier","doi":"10.1145/1015330.1015336","DOIUrl":"https://doi.org/10.1145/1015330.1015336","url":null,"abstract":"In this paper we focus on the adaptation of boosting to grammatical inference. We aim at improving the performance of state merging algorithms in the presence of noisy data by using, in the update rule, additional information provided by an oracle. This strategy requires the construction of a new weighting scheme that takes into account the confidence in the labels of the examples. We prove that our new framework preserves the theoretical properties of boosting. Using the state merging algorithm RPNI*, we describe an experimental study on various datasets, showing a dramatic improvement of performances.","PeriodicalId":159792,"journal":{"name":"Proceedings of the twenty-first international conference on Machine learning","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2004-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128266834","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Entropy-based criterion in categorical clustering 分类聚类中基于熵的准则
Proceedings of the twenty-first international conference on Machine learning Pub Date : 2004-07-04 DOI: 10.1145/1015330.1015404
Tao Li, Sheng Ma, M. Ogihara
{"title":"Entropy-based criterion in categorical clustering","authors":"Tao Li, Sheng Ma, M. Ogihara","doi":"10.1145/1015330.1015404","DOIUrl":"https://doi.org/10.1145/1015330.1015404","url":null,"abstract":"Entropy-type measures for the heterogeneity of clusters have been used for a long time. This paper studies the entropy-based criterion in clustering categorical data. It first shows that the entropy-based criterion can be derived in the formal framework of probabilistic clustering models and establishes the connection between the criterion and the approach based on dissimilarity co-efficients. An iterative Monte-Carlo procedure is then presented to search for the partitions minimizing the criterion. Experiments are conducted to show the effectiveness of the proposed procedure.","PeriodicalId":159792,"journal":{"name":"Proceedings of the twenty-first international conference on Machine learning","volume":"62 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2004-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131164987","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 188
Towards tight bounds for rule learning 对规则学习的严格限制
Proceedings of the twenty-first international conference on Machine learning Pub Date : 2004-07-04 DOI: 10.1145/1015330.1015387
U. Rückert, Stefan Kramer
{"title":"Towards tight bounds for rule learning","authors":"U. Rückert, Stefan Kramer","doi":"10.1145/1015330.1015387","DOIUrl":"https://doi.org/10.1145/1015330.1015387","url":null,"abstract":"While there is a lot of empirical evidence showing that traditional rule learning approaches work well in practice, it is nearly impossible to derive analytical results about their predictive accuracy. In this paper, we investigate rule-learning from a theoretical perspective. We show that the application of McAllester's PAC-Bayesian bound to rule learning yields a practical learning algorithm, which is based on ensembles of weighted rule sets. Experiments with the resulting learning algorithm show not only that it is competitive with state-of-the-art rule learners, but also that its error rate can often be bounded tightly. In fact, the bound turns out to be tighter than one of the \"best\" bounds for a practical learning scheme known so far (the Set Covering Machine). Finally, we prove that the bound can be further improved by allowing the learner to abstain from uncertain predictions.","PeriodicalId":159792,"journal":{"name":"Proceedings of the twenty-first international conference on Machine learning","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2004-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131467937","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 14
A multiplicative up-propagation algorithm 一种乘法向上传播算法
Proceedings of the twenty-first international conference on Machine learning Pub Date : 2004-07-04 DOI: 10.1145/1015330.1015379
Jong-Hoon Ahn, Seungjin Choi, Jong-Hoon Oh
{"title":"A multiplicative up-propagation algorithm","authors":"Jong-Hoon Ahn, Seungjin Choi, Jong-Hoon Oh","doi":"10.1145/1015330.1015379","DOIUrl":"https://doi.org/10.1145/1015330.1015379","url":null,"abstract":"We present a generalization of the nonnegative matrix factorization (NMF), where a multilayer generative network with nonnegative weights is used to approximate the observed nonnegative data. The multilayer generative network with nonnegativity constraints, is learned by a multiplicative uppropagation algorithm, where the weights in each layer are updated in a multiplicative fashion while the mismatch ratio is propagated from the bottom to the top layer. The monotonic convergence of the multiplicative up-propagation algorithm is shown. In contrast to NMF, the multiplicative uppropagation is an algorithm that can learn hierarchical representations, where complex higher-level representations are defined in terms of less complex lower-level representations. The interesting behavior of our algorithm is demonstrated with face image data.","PeriodicalId":159792,"journal":{"name":"Proceedings of the twenty-first international conference on Machine learning","volume":"95 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2004-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133299985","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 21
A graphical model for protein secondary structure prediction 蛋白质二级结构预测的图形模型
Proceedings of the twenty-first international conference on Machine learning Pub Date : 2004-07-04 DOI: 10.1145/1015330.1015354
Wei Chu, Zoubin Ghahramani, D. Wild
{"title":"A graphical model for protein secondary structure prediction","authors":"Wei Chu, Zoubin Ghahramani, D. Wild","doi":"10.1145/1015330.1015354","DOIUrl":"https://doi.org/10.1145/1015330.1015354","url":null,"abstract":"In this paper, we present a graphical model for protein secondary structure prediction. This model extends segmental semi-Markov models (SSMM) to exploit multiple sequence alignment profiles which contain information from evolutionarily related sequences. A novel parameterized model is proposed as the likelihood function for the SSMM to capture the segmental conformation. By incorporating the information from long range interactions in ß-sheets, this model is capable of carrying out inference on contact maps. The numerical results on benchmark data sets show that incorporating the profiles results in substantial improvements and the generalization performance is promising.","PeriodicalId":159792,"journal":{"name":"Proceedings of the twenty-first international conference on Machine learning","volume":"47 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2004-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116967705","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 44
Feature extraction via generalized uncorrelated linear discriminant analysis 基于广义非相关线性判别分析的特征提取
Proceedings of the twenty-first international conference on Machine learning Pub Date : 2004-07-04 DOI: 10.1145/1015330.1015348
Jieping Ye, Ravi Janardan, Qi Li, Haesun Park
{"title":"Feature extraction via generalized uncorrelated linear discriminant analysis","authors":"Jieping Ye, Ravi Janardan, Qi Li, Haesun Park","doi":"10.1145/1015330.1015348","DOIUrl":"https://doi.org/10.1145/1015330.1015348","url":null,"abstract":"Feature extraction is important in many applications, such as text and image retrieval, because of high dimensionality. Uncorrelated Linear Discriminant Analysis (ULDA) was recently proposed for feature extraction. The extracted features via ULDA were shown to be statistically uncorrelated, which is desirable for many applications. In this paper, we will first propose the ULDA/QR algorithm to simplify the previous implementation of ULDA. Then we propose the ULDA/GSVD algorithm, based on a novel optimization criterion, to address the singularity problem. It is applicable for undersampled problem, where the data dimension is much larger than the data size, such as text and image retrieval. The novel criterion used in ULDA/GSVD is the perturbed version of the one from ULDA/QR, while surprisingly, the solution to ULDA/GSVD is shown to be independent of the amount of perturbation applied. We did extensive experiments on text and face image data to show the effectiveness of ULDA/GSVD and compare with other popular feature extraction algorithms.","PeriodicalId":159792,"journal":{"name":"Proceedings of the twenty-first international conference on Machine learning","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2004-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126043162","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 46
Training conditional random fields via gradient tree boosting 通过梯度树增强训练条件随机场
Proceedings of the twenty-first international conference on Machine learning Pub Date : 2004-07-04 DOI: 10.1145/1015330.1015428
Thomas G. Dietterich, A. Ashenfelter, Yaroslav Bulatov
{"title":"Training conditional random fields via gradient tree boosting","authors":"Thomas G. Dietterich, A. Ashenfelter, Yaroslav Bulatov","doi":"10.1145/1015330.1015428","DOIUrl":"https://doi.org/10.1145/1015330.1015428","url":null,"abstract":"Conditional Random Fields (CRFs; Lafferty, McCallum, & Pereira, 2001) provide a flexible and powerful model for learning to assign labels to elements of sequences in such applications as part-of-speech tagging, text-to-speech mapping, protein and DNA sequence analysis, and information extraction from web pages. However, existing learning algorithms are slow, particularly in problems with large numbers of potential input features. This paper describes a new method for training CRFs by applying Friedman's (1999) gradient tree boosting method. In tree boosting, the CRF potential functions are represented as weighted sums of regression trees. Regression trees are learned by stage-wise optimizations similar to Adaboost, but with the objective of maximizing the conditional likelihood P(Y|X) of the CRF model. By growing regression trees, interactions among features are introduced only as needed, so although the parameter space is potentially immense, the search algorithm does not explicitly consider the large space. As a result, gradient tree boosting scales linearly in the order of the Markov model and in the order of the feature interactions, rather than exponentially like previous algorithms based on iterative scaling and gradient descent.","PeriodicalId":159792,"journal":{"name":"Proceedings of the twenty-first international conference on Machine learning","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2004-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126928656","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 158
Variational methods for the Dirichlet process 狄利克雷过程的变分方法
Proceedings of the twenty-first international conference on Machine learning Pub Date : 2004-07-04 DOI: 10.1145/1015330.1015439
D. Blei, Michael I. Jordan
{"title":"Variational methods for the Dirichlet process","authors":"D. Blei, Michael I. Jordan","doi":"10.1145/1015330.1015439","DOIUrl":"https://doi.org/10.1145/1015330.1015439","url":null,"abstract":"Variational inference methods, including mean field methods and loopy belief propagation, have been widely used for approximate probabilistic inference in graphical models. While often less accurate than MCMC, variational methods provide a fast deterministic approximation to marginal and conditional probabilities. Such approximations can be particularly useful in high dimensional problems where sampling methods are too slow to be effective. A limitation of current methods, however, is that they are restricted to parametric probabilistic models. MCMC does not have such a limitation; indeed, MCMC samplers have been developed for the Dirichlet process (DP), a nonparametric distribution on distributions (Ferguson, 1973) that is the cornerstone of Bayesian nonparametric statistics (Escobar & West, 1995; Neal, 2000). In this paper, we develop a mean-field variational approach to approximate inference for the Dirichlet process, where the approximate posterior is based on the truncated stick-breaking construction (Ishwaran & James, 2001). We compare our approach to DP samplers for Gaussian DP mixture models.","PeriodicalId":159792,"journal":{"name":"Proceedings of the twenty-first international conference on Machine learning","volume":"92 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2004-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122050983","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 188
Bellman goes relational Bellman是关系型的
Proceedings of the twenty-first international conference on Machine learning Pub Date : 2004-07-04 DOI: 10.1145/1015330.1015401
K. Kersting, M. V. Otterlo, L. D. Raedt
{"title":"Bellman goes relational","authors":"K. Kersting, M. V. Otterlo, L. D. Raedt","doi":"10.1145/1015330.1015401","DOIUrl":"https://doi.org/10.1145/1015330.1015401","url":null,"abstract":"Motivated by the interest in relational reinforcement learning, we introduce a novel relational Bellman update operator called REBEL. It employs a constraint logic programming language to compactly represent Markov decision processes over relational domains. Using REBEL, a novel value iteration algorithm is developed in which abstraction (over states and actions) plays a major role. This framework provides new insights into relational reinforcement learning. Convergence results as well as experiments are presented.","PeriodicalId":159792,"journal":{"name":"Proceedings of the twenty-first international conference on Machine learning","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2004-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114353811","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 121
Solving cluster ensemble problems by bipartite graph partitioning 用二部图划分方法求解聚类集成问题
Proceedings of the twenty-first international conference on Machine learning Pub Date : 2004-07-04 DOI: 10.1145/1015330.1015414
Xiaoli Z. Fern, C. Brodley
{"title":"Solving cluster ensemble problems by bipartite graph partitioning","authors":"Xiaoli Z. Fern, C. Brodley","doi":"10.1145/1015330.1015414","DOIUrl":"https://doi.org/10.1145/1015330.1015414","url":null,"abstract":"A critical problem in cluster ensemble research is how to combine multiple clusterings to yield a final superior clustering result. Leveraging advanced graph partitioning techniques, we solve this problem by reducing it to a graph partitioning problem. We introduce a new reduction method that constructs a bipartite graph from a given cluster ensemble. The resulting graph models both instances and clusters of the ensemble simultaneously as vertices in the graph. Our approach retains all of the information provided by a given ensemble, allowing the similarity among instances and the similarity among clusters to be considered collectively in forming the final clustering. Further, the resulting graph partitioning problem can be solved efficiently. We empirically evaluate the proposed approach against two commonly used graph formulations and show that it is more robust and achieves comparable or better performance in comparison to its competitors.","PeriodicalId":159792,"journal":{"name":"Proceedings of the twenty-first international conference on Machine learning","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2004-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133438673","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 571
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书