Zhongwei Xie, Ling Liu, Yanzhao Wu, Lin Li, Luo Zhong
{"title":"Cross-Modal Joint Embedding with Diverse Semantics","authors":"Zhongwei Xie, Ling Liu, Yanzhao Wu, Lin Li, Luo Zhong","doi":"10.1109/CogMI50398.2020.00028","DOIUrl":"https://doi.org/10.1109/CogMI50398.2020.00028","url":null,"abstract":"Textual-visual cross-modal retrieval has been an active research area in both computer vision and natural language processing communities. Most existing works learn a joint embedding model that maps raw text-image pairs onto a joint latent representation space in which the similarity between textual embeddings and visual embeddings can be computed and compared, without leveraging diverse semantics. This paper presents a general framework to study and evaluate the impact of diverse semantics extracted from the multi-modal input data on the quality and performance of joint embedding learning. We identify different ways that conventional textual features, such as TFIDF term frequency semantics and image category semantics, can be combined with neural features to further boost the efficiency of joint embedding learning. Experiments on the benchmark dataset Recipe1M demonstrates that existing representative cross-modal joint embedding approaches enhanced with diverse semantics in both raw inputs and joint embedding loss optimization can effectively boost their cross-modal retrieval performance.","PeriodicalId":360326,"journal":{"name":"2020 IEEE Second International Conference on Cognitive Machine Intelligence (CogMI)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131857033","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Towards Distributed Edge-based Systems","authors":"S. Dustdar, Ilir Murturi","doi":"10.1109/CogMI50398.2020.00021","DOIUrl":"https://doi.org/10.1109/CogMI50398.2020.00021","url":null,"abstract":"In the past few years, researchers from academia and industry stakeholders suggest adding more computational resources (i.e., storage, networking, and processing) closer to the end-users and IoT domain, respectively, at the edge of the network. Such computation entities perceived as edge devices aim to overcome high-latency issues between the cloud and the IoT domain. Thus, processing IoT data streams closer to the end-users and IoT domain can solve several operational challenges. Since then, a plethora of application-specific IoT systems are introduced, mainly hard-coded, inflexible, and limited extensibility for future changes. Additionally, most IoT systems maintain a centralized design to operate without considering the dynamic nature of edge networks. In this paper, we discuss some of the research issues, challenges, and potential solutions to enable: i) deploying edge functions on edge resources in a distributed manner and ii) deploying and scaling edge applications on-premises of Edge-Cloud infrastructure. Additionally, we discuss in detail the three-tier Edge-Cloud architecture. Finally, we introduce a conceptual framework that aims to enable easy configuration and deployment of edge-based systems on top of heterogeneous edge infrastructure and present our vision within a smart city scenario.","PeriodicalId":360326,"journal":{"name":"2020 IEEE Second International Conference on Cognitive Machine Intelligence (CogMI)","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124620313","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Benjamin M. Marlin, T. Abdelzaher, G. Ciocarlie, Adam D. Cobb, Mark S. Dennison, Brian Jalaian, Lance M. Kaplan, Tiffany R. Raber, A. Raglin, P. Sharma, M. Srivastava, T. Trout, Meet P. Vadera, Maggie B. Wigness
{"title":"On Uncertainty and Robustness in Large-Scale Intelligent Data Fusion Systems","authors":"Benjamin M. Marlin, T. Abdelzaher, G. Ciocarlie, Adam D. Cobb, Mark S. Dennison, Brian Jalaian, Lance M. Kaplan, Tiffany R. Raber, A. Raglin, P. Sharma, M. Srivastava, T. Trout, Meet P. Vadera, Maggie B. Wigness","doi":"10.1109/CogMI50398.2020.00020","DOIUrl":"https://doi.org/10.1109/CogMI50398.2020.00020","url":null,"abstract":"The resurgence of AI in the recent decade dramatically changes the design of modern sensor data fusion systems, leading to new challenges, opportunities, and research directions. One of these challenges is the management of uncertainty. This paper develops a framework to reason about sources of uncertainty, develops representations of uncertainty, and investigates uncertainty mitigation strategies in modern intelligent data processing systems. Insights are developed into workflow composition that maximizes efficacy at accomplishing mission goals despite the sources of uncertainty, while leveraging a collaboration of humans, algorithms, and machine learning components.","PeriodicalId":360326,"journal":{"name":"2020 IEEE Second International Conference on Cognitive Machine Intelligence (CogMI)","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129056705","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"2020 IEEE Second International Conference on Cognitive Machine Intelligence (CogMI) CogMI 2020","authors":"","doi":"10.1109/cogmi50398.2020.00004","DOIUrl":"https://doi.org/10.1109/cogmi50398.2020.00004","url":null,"abstract":"","PeriodicalId":360326,"journal":{"name":"2020 IEEE Second International Conference on Cognitive Machine Intelligence (CogMI)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129603640","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Conference Keynote: Synthesizing Interpretable Behavior for Human-Aware AI Systems","authors":"S. Kambhampati","doi":"10.1109/cogmi50398.2020.00010","DOIUrl":"https://doi.org/10.1109/cogmi50398.2020.00010","url":null,"abstract":"","PeriodicalId":360326,"journal":{"name":"2020 IEEE Second International Conference on Cognitive Machine Intelligence (CogMI)","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126128909","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Social Media and Ubiquitous Technologies for Remote Worker Wellbeing and Productivity in a Post-Pandemic World","authors":"V. D. Swain, Koustuv Saha, G. Abowd, M. Choudhury","doi":"10.1109/CogMI50398.2020.00025","DOIUrl":"https://doi.org/10.1109/CogMI50398.2020.00025","url":null,"abstract":"In light of the ongoing COVID-19 pandemic, remote work styles have become the norm. However, these work settings introduce new intricacies in worker behaviors. The overlap between work and home can disrupt performance. The lack of social interaction can affect motivation. This elicits a need to implement novel methods to evaluate and enhance remote worker functioning. The potential to unobtrusively and automatically assess such workers can be fulfilled by social media and ubiquitous technologies. This paper situates recent research in the new context by extending our insights for increased remote interaction and online presence. We present implications for proactive assessment of remote workers by understanding day-level activities, coordination, role awareness, and organizational culture. Additionally, we discuss the ethics of privacy-preserving deployment, employer surveillance, and digital inequity. This paper aims to inspire pervasive technologies for the new future of work.","PeriodicalId":360326,"journal":{"name":"2020 IEEE Second International Conference on Cognitive Machine Intelligence (CogMI)","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-07-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116534269","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}