{"title":"Interactive Supervision with t-SNE","authors":"F. Luus, Naweed Khan, I. Akhalwaya","doi":"10.1145/3360901.3364414","DOIUrl":"https://doi.org/10.1145/3360901.3364414","url":null,"abstract":"Knowledge capture from human experts in domain-specific settings can benefit from incisive use of machine intelligence to reduce expended time and effort. Such a capability can be of significant value to deep learning, given its demand for large labeled data. We propose an ML-based system for interactive labeling of image datasets to speed up class attribution performed by domain experts. The tool visualizes feature spaces and makes it directly editable through online integration of applied labels. We propose realistic annotation emulation to evaluate the system design of interactive active learning, based on our improved semi-supervised extension of t-SNE dimensionality reduction. We contribute globally normalized attractions, semi-supervised repulsion, smoothed label integration, and parameter optimization in our improved t-SNE. Our active learning tool can significantly increase labeling efficiency compared to uncertainty sampling, and we show that less than 100 labeling actions are typically sufficient for good classification on a variety of specialized image datasets. Our contribution is unique given that it needs to perform dimensionality reduction, feature space visualization and editing, interactive label propagation, low-complexity active learning, human perceptual modeling, annotation emulation and unsupervised feature extraction for specialized datasets in a production-quality implementation.","PeriodicalId":116830,"journal":{"name":"Proceedings of the 10th International Conference on Knowledge Capture","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122563379","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Cooperative Web Agents by Combining Semantic Technologies with Reinforcement Learning","authors":"Nicole Merkle, Patrick Philipp","doi":"10.1145/3360901.3364417","DOIUrl":"https://doi.org/10.1145/3360901.3364417","url":null,"abstract":"An increasing number of Web pages are enriched with semantic annotations using, for instance, RDFa and Schema.org in order to ease data interpretation for Web browsers and search engines. Lifted data representations might enable a new class of semantic agents for complex decision-making on the Web, reaching from filling out Web forms and booking flights to mastering any Web-based task. However, exclusively using semantic models has several drawbacks, such as extensive manual efforts for enabling semantic agents to solve Web tasks or limited capabilities to personalize task solutions for end users. While using semantics is a crucial component for guiding prospective semantic agents, we have to find a balance between modelling rich background knowledge and learning optimal agent behaviour through advanced Machine Learning (ML) methods. In this work, we propose a semantic agent framework for (i) modelling agent-related semantic annotations for Web tasks, (ii) using the latter to train statistical agents using Reinforcement Learning (RL) in an offline simulation as well as in real online use and (iii) feeding back the learned agent behaviour and its provenance information in terms of a semantic model that can be directly used by purely semantics-based agents. We evaluate our approach based on the MiniWob++ benchmark for automatically solving Web tasks. We show that our proposed semantic agent framework enables to (i) warm start agents with semantic background knowledge to faster learn task-dependent optimal behaviour in terms of the expected cumulative reward and (ii) directly reuse the learned behaviour by semantic-based agents that act by automatically derived Notation3 (N3) implication rules.","PeriodicalId":116830,"journal":{"name":"Proceedings of the 10th International Conference on Knowledge Capture","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127871554","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Reflections on Structured Common Sense in an Era of Machine Learning","authors":"Catherine Havasi","doi":"10.1145/3360901.3364450","DOIUrl":"https://doi.org/10.1145/3360901.3364450","url":null,"abstract":"Crowdsourcing common sense training data was born twenty years ago. It began with the idea to \"harness the power of bored people on the Internet\" to collect \"what everyone knows but no one writes down\". This was an era when we were all just starting to learn how to search the web, before people learned the dismal art of keywords, they tried typing their wants and needs. Search engines were woefully unequipped for these kinds of queries, and it was in that climate that we started ConceptNet, which we originally called OpenMind CommonSense (OMCS). Over the years, the effort and its methods evolved to address new applications. Today, we explore how structured common sense is becoming more relevant in NLP and the role it can play in helping solve problems of explainability, scalability, low-resourced languages, domain transfer, and AI bias. We look at how structured common sense and transformers are complementary and how we can combine them to keep the best of both worlds. Additionally, how does common sense need to evolve as we tackle larger and more complex and cross domain problems?","PeriodicalId":116830,"journal":{"name":"Proceedings of the 10th International Conference on Knowledge Capture","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115885239","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Thamer Mecharnia, L. Khelifa, N. Pernelle, F. Hamdi
{"title":"An Approach Toward a Prediction of the Presence of Asbestos in Buildings Based on Incomplete Temporal Descriptions of Marketed Products","authors":"Thamer Mecharnia, L. Khelifa, N. Pernelle, F. Hamdi","doi":"10.1145/3360901.3364428","DOIUrl":"https://doi.org/10.1145/3360901.3364428","url":null,"abstract":"Since 1997, the production, import and sale of asbestosfootnoteNaturally occurring mineral fibres which were used due to their insulating properties. have been banned in France. However, there are still millions of tons scattered in factories, buildings, or hospitals. In this paper we propose a method for predicting the presence of asbestos products in buildings based on temporal data that describes the probability of the presence of asbestos in marketed products.","PeriodicalId":116830,"journal":{"name":"Proceedings of the 10th International Conference on Knowledge Capture","volume":"55 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126510005","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Project Aristo: Towards Machines that Capture and Reason with Science Knowledge","authors":"Peter Clark","doi":"10.1145/3360901.3364451","DOIUrl":"https://doi.org/10.1145/3360901.3364451","url":null,"abstract":"AI2's Project Aristo seeks to build a system that has a deep understanding of science, using knowledge captured mainly from large-scale text. Recently, Aristo achieved surprising success on the Grade 8 New York Regents Science Exams, scoring over 90% on the exam's non-diagram, multiple choice (NDMC) questions, where even 3 years ago the best systems scored less than 60%. In this talk, I will describe the journey of Aristo through various knowledge capture technologies that have helped it, including acquiring if/then rules, tables, knowledge graphs, and latent neural representations. I will also discuss the growing tension between capturing structured knowledge vs. capturing knowledge latently using neural models, the latter proving highly effective but hard to interpret. Finally I will speculate on the larger quest towards knowledgable machines that can reason, explain, and discuss, and how structured and latent knowledge can interact to help reach this goal.","PeriodicalId":116830,"journal":{"name":"Proceedings of the 10th International Conference on Knowledge Capture","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133374957","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ling Cai, Bo Yan, Gengchen Mai, K. Janowicz, Rui Zhu
{"title":"TransGCN: Coupling Transformation Assumptions with Graph Convolutional Networks for Link Prediction","authors":"Ling Cai, Bo Yan, Gengchen Mai, K. Janowicz, Rui Zhu","doi":"10.1145/3360901.3364441","DOIUrl":"https://doi.org/10.1145/3360901.3364441","url":null,"abstract":"Link prediction is an important and frequently studied task that contributes to an understanding of the structure of knowledge graphs (KGs) in statistical relational learning. Inspired by the success of graph convolutional networks (GCN) in modeling graph data, we propose a unified GCN framework, named TransGCN, to address this task, in which relation and entity embeddings are learned simultaneously. To handle heterogeneous relations in KGs, we introduce a novel way of representing heterogeneous neighborhood by introducing transformation assumptions on the relationship between the subject, the relation, and the object of a triple. Specifically, a relation is treated as a transformation operator transforming a head entity to a tail entity. Both translation assumption in TransE and rotation assumption in RotatE are explored in our framework. Additionally, instead of only learning entity embeddings in the convolution-based encoder while learning relation embeddings in the decoder as done by the state-of-art models, e.g., R-GCN, the TransGCN framework trains relation embeddings and entity embeddings simultaneously during the graph convolution operation, thus having fewer parameters compared with R-GCN. Experiments show that our models outperform the-state-of-arts methods on both FB15K-237 and WN18RR.","PeriodicalId":116830,"journal":{"name":"Proceedings of the 10th International Conference on Knowledge Capture","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129364407","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Gengchen Mai, K. Janowicz, Bo Yan, Rui Zhu, Ling Cai, N. Lao
{"title":"Contextual Graph Attention for Answering Logical Queries over Incomplete Knowledge Graphs","authors":"Gengchen Mai, K. Janowicz, Bo Yan, Rui Zhu, Ling Cai, N. Lao","doi":"10.1145/3360901.3364432","DOIUrl":"https://doi.org/10.1145/3360901.3364432","url":null,"abstract":"Recently, several studies have explored methods for using KG embedding to answer logical queries. These approaches either treat embedding learning and query answering as two separated learning tasks, or fail to deal with the variability of contributions from different query paths. We proposed to leverage a graph attention mechanism to handle the unequal contribution of different query paths. However, commonly used graph attention assumes that the center node embedding is provided, which is unavailable in this task since the center node is to be predicted. To solve this problem we propose a multi-head attention-based end-to-end logical query answering model, called Contextual Graph Attention model (CGA), which uses an initial neighborhood aggregation layer to generate the center embedding, and the whole model is trained jointly on the original KG structure as well as the sampled query-answer pairs. We also introduce two new datasets, DB18 and WikiGeo19, which are rather large in size compared to the existing datasets and contain many more relation types, and use them to evaluate the performance of the proposed model. Our result shows that the proposed CGA with fewer learnable parameters consistently outperforms the baseline models on both datasets as well as Bio dataset.","PeriodicalId":116830,"journal":{"name":"Proceedings of the 10th International Conference on Knowledge Capture","volume":"226 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124486516","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Jointly Learning from Social Media and Environmental Data for Typhoon Intensity Prediction","authors":"Hamada M. Zahera, M. A. Sherif, A. N. Ngomo","doi":"10.1145/3360901.3364413","DOIUrl":"https://doi.org/10.1145/3360901.3364413","url":null,"abstract":"Existing technologies employ different machine learning approachesto predict disasters from historical environmental data. However,for short-term disasters (e.g., earthquakes), historical data alonehas a limited prediction capability. In this work, we consider so-cial media as a supplementary source of knowledge in additionto historical environmental data. Further, we build a joint modelthat learns from disaster-related tweets and environmental data toimprove prediction. We propose the combination of semantically-enriched word embedding to represent entities in tweets with theirsemantics representations computed with the traditionalword2vec.Our experiments show that our proposed approach outperformsthe accuracy of state-of-the-art models in disaster prediction","PeriodicalId":116830,"journal":{"name":"Proceedings of the 10th International Conference on Knowledge Capture","volume":"468 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123049210","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"On the Robustness of Domain-Independent Planning Engines: The Impact of Poorly-Engineered Knowledge","authors":"M. Vallati, L. Chrpa","doi":"10.1145/3360901.3364416","DOIUrl":"https://doi.org/10.1145/3360901.3364416","url":null,"abstract":"Recent advances in automated planning are leading towards the use of planning engines in a wide range of real-world applications. As the exploitation of planning techniques in applications increases, it becomes imperative to assess the robustness of planning engines with regards to poorly-engineered (or maliciously modified) knowledge models provided as input for the reasoning process. In this work, to understand the impact of poorly-engineered knowledge on planning engines, we consider the perspective of a hypothetical attacker that is interested in subtly manipulating such knowledge to introduce unnecessary overheads that consequently slow down the planning process. This narrative ploy allows us to describe different types of knowledge engineering issues that cannot be detected via validation of the models, and to measure their impact on the performance of a range of planning engines exploiting very different approaches for steps like pre-processing and search.","PeriodicalId":116830,"journal":{"name":"Proceedings of the 10th International Conference on Knowledge Capture","volume":"64 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116437283","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Md Reshad Ul Hoque, D. Bradley, C. Kwan, Agnese Chiatti, Jiang Li, Jian Wu
{"title":"Searching for Evidence of Scientific News in Scholarly Big Data","authors":"Md Reshad Ul Hoque, D. Bradley, C. Kwan, Agnese Chiatti, Jiang Li, Jian Wu","doi":"10.1145/3360901.3364438","DOIUrl":"https://doi.org/10.1145/3360901.3364438","url":null,"abstract":"Public digital media can often mix factual information with fake scientific news, which is typically difficult to pinpoint, especially for non-professionals. These scientific news articles create illusions and misconceptions, thus ultimately influence the public opinion, with serious consequences at a broader social scale. Yet, existing solutions aiming at automatically verifying the credibility of news articles are still unsatisfactory. We propose to verify scientific news by retrieving and analyzing its most relevant source papers from an academic digital library (DL), e.g., arXiv. Instead of querying keywords or regular named entities extracted from news articles, we query domain knowledge entities (DKEs) extracted from the text. By querying each DKE, we retrieve a list of candidate scholarly papers. We then design a function to rank them and select the most relevant scholarly paper. After exploring various representations, experiments indicate that the term frequency-inverse document frequency (TF-IDF) representation with cosine similarity outperforms baseline models based on word embedding. This result demonstrates the efficacy of using DKEs to retrieve scientific papers which are relevant to a specific news article. It also indicates that word embedding may not be the best document representation for domain specific document retrieval tasks. Our method is fully automated and can be effectively applied to facilitating fake and misinformed news detection across many scientific domains.","PeriodicalId":116830,"journal":{"name":"Proceedings of the 10th International Conference on Knowledge Capture","volume":"152 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115433814","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}