{"title":"FacetRules: Discovering and Describing Related Groups","authors":"Lebna V. Thomas, Jiahao Deng, Eli T. Brown","doi":"10.1109/MLUI54255.2021.00008","DOIUrl":"https://doi.org/10.1109/MLUI54255.2021.00008","url":null,"abstract":"Domain experts, owing to their knowledge and experience, develop an intuition for patterns in the data. They may know, for example, certain points of interest. However, they may not know exactly how to characterize what makes these data special. In our work, we start from these points of interest as seeds to derive groups of similar points automatically based on surrounding cluster structure. To aid characterization, we provide descriptive rules as an interpretable model to describe the groups. We explain this technique and present a prototype to demonstrate with a usage scenario how the technique helps the user with data exploration by discovering and describing groups in the data.","PeriodicalId":206908,"journal":{"name":"2021 IEEE Workshop on Machine Learning from User Interactions (MLUI)","volume":"257 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133385777","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"[Copyright notice]","authors":"","doi":"10.1109/mlui54255.2021.00003","DOIUrl":"https://doi.org/10.1109/mlui54255.2021.00003","url":null,"abstract":"","PeriodicalId":206908,"journal":{"name":"2021 IEEE Workshop on Machine Learning from User Interactions (MLUI)","volume":"280 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121822367","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"MLUI 2021 Overview","authors":"","doi":"10.1109/mlui54255.2021.00005","DOIUrl":"https://doi.org/10.1109/mlui54255.2021.00005","url":null,"abstract":"","PeriodicalId":206908,"journal":{"name":"2021 IEEE Workshop on Machine Learning from User Interactions (MLUI)","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124147186","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sriram Yarlagadda, David J. Scroggins, Fang Cao, Yeshwanth Devabhaktuni, Franklin Buitron, Eli T. Brown
{"title":"DocTable: Table-Oriented Interactive Machine Learning for Text Corpora","authors":"Sriram Yarlagadda, David J. Scroggins, Fang Cao, Yeshwanth Devabhaktuni, Franklin Buitron, Eli T. Brown","doi":"10.1109/MLUI54255.2021.00006","DOIUrl":"https://doi.org/10.1109/MLUI54255.2021.00006","url":null,"abstract":"People working today with text data in any domain must develop understanding based on more documents than they can directly read. Tools exist that take advantage of visual analytics for a variety of text data tasks, including for technical experts, particularly in certain domains like intelligence and law. There is a missed opportunity to apply human-in-the-loop (HIL) machine learning to assist a general audience with text analysis tasks over large corpora that are difficult with visualization alone. In this paper, we propose an alternate approach to efficient sensemaking over document corpora, designed for users without technical expertise or training. We use a table-based interface, where the primary means of providing feedback to the machine is interactions with a data table view. This format is familiar to many, and augments the ability to tag documents into user-defined categories with machine learning that automatically predicts categories for additional documents. Marking only a few documents enables the machine learner to suggest automatic labels for the rest (with uncertainty scores for the predictions), and to reorder the table to reflect an integrated mix of the category models. Finally, interactive, force-directed layouts of topics and documents based on the models assist in sensemaking for workflow that scales beyond the practical limits of a table. To validate the technique, we present a prototype human-in-the-loop machine learning system, DocTable. We evaluate this technique with machine learning experiments that demonstrate the quality of the backend’s response to expected user inputs, a usage scenario to demonstrate its use on real world data, and a case study of expert feedback from our journalist collaborators.","PeriodicalId":206908,"journal":{"name":"2021 IEEE Workshop on Machine Learning from User Interactions (MLUI)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131360403","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"SHIM: Semantic Hierarchical clustering with Interactive Machine learning","authors":"Fang Cao, Yuanwei Tu, Eli T. Brown","doi":"10.1109/MLUI54255.2021.00007","DOIUrl":"https://doi.org/10.1109/MLUI54255.2021.00007","url":null,"abstract":"Clustering is widely used, and there are available techniques for using semantic interactions to incorporate human feedback. Hierarchical agglomerative clustering produces complete substructure, offering rich possibilities for user interactions. However, currently available human-in-the-loop techniques miss out on the advantages of hierarchical agglomerative clustering. In this paper, we present a technique, SHIM, for semantic, interactive hierarchical clustering that helps users understand their data through exploring and modifying clusters and cluster substructure with semantic interactions and automatic descriptive rules. The proposed solution includes a compact visualization of hierarchical clustering customized for this context and connected to a table view that shows data detail and descriptive rules simultaneously. We assess our design decision and usability with expert feedback, and use simulations to test whether the metric learning method will improve a model with limited interactions.","PeriodicalId":206908,"journal":{"name":"2021 IEEE Workshop on Machine Learning from User Interactions (MLUI)","volume":"47 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116822055","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}