Jaehee Lee, Joongchol Shin, Heunseung Lim, J. Paik
{"title":"Deep High Dynamic Range Imaging without Motion Artifacts Using Global and Local Skip Connections","authors":"Jaehee Lee, Joongchol Shin, Heunseung Lim, J. Paik","doi":"10.1109/ICCE53296.2022.9730322","DOIUrl":"https://doi.org/10.1109/ICCE53296.2022.9730322","url":null,"abstract":"This paper proposes a new HDR image generation method using a deep residual network. The proposed method aligns input images of three low dynamic range (LDR) images with different exposure times for the same scene based on the images with intermediate exposure times and uses them as input to the network. In the network, three LDR images and three images converted into high dynamic range (HDR) regions are input, and three LDR images with improved artifacts and an alpha map are output to generate HDR images. The method proposed through the experimental results can show HDR images without color distortion or ghosting artifact when compared to the existing method, and good performance compared to the HDR function used in consumer imaging systems.","PeriodicalId":350644,"journal":{"name":"2022 IEEE International Conference on Consumer Electronics (ICCE)","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-01-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124303466","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Visual and Location Information Fusion for Hierarchical Place Recognition","authors":"Dulmini Hettiarachchi, S. Kamijo","doi":"10.1109/ICCE53296.2022.9730537","DOIUrl":"https://doi.org/10.1109/ICCE53296.2022.9730537","url":null,"abstract":"Recognizing places of interest in an unfamiliar environment has been a common challenge faced by humans. This paper presents a novel hierarchical place recognition system capable of general outdoor place recognition including landmarks, commercial buildings, and business entities. We aim to achieve this by fusing visual and location information. Our hierarchical approach comprises place of interest detection, location-based filtering, image similarity score-based ranking and information retrieval components. The system leverages state of the art deep learning models for place detection and deep feature extraction. To evaluate our proposed system, we introduce a new dense dataset, referred to as Tokyo Outdoor Places, consisting of landmarks, commercial buildings, and business entities. Our proposed hierarchical system achieves 95.69% recall on our new dataset. We believe our system can contribute in achieving smart city goals by providing access to information, enabling locals and tourists to navigate with ease.","PeriodicalId":350644,"journal":{"name":"2022 IEEE International Conference on Consumer Electronics (ICCE)","volume":"113 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-01-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124337640","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Edgar Sarmiento-Calisaya, P. Calcina-Ccori, Álvaro E. Cuno Parari
{"title":"An Emotion-Aware Persuasive Architecture to Support Challenging Classroom Situations","authors":"Edgar Sarmiento-Calisaya, P. Calcina-Ccori, Álvaro E. Cuno Parari","doi":"10.1109/ICCE53296.2022.9730567","DOIUrl":"https://doi.org/10.1109/ICCE53296.2022.9730567","url":null,"abstract":"Nowadays, students face stressful situations that affect their mental health and negatively impact their academic performance. This situation has been exacerbated due to the COVID-19 pandemics. Teaching and learning process stakeholders face two main problems: the lack of awareness of the situations arising from students and the little available information that support the teaching activities. Here, we propose an emotion-aware architecture for persuasive systems in education, identifying challenging classroom situations and promoting mental health through multi-modal persuasive notifications. An important module is emotion inference, which reads real-time physiological data from students through the Empatica E4 wristband. Based on this architecture, we developed the Kusisqa persuasive system, to support students in regulating their negative emotions (They can all lead to stress) during challenging classroom situations. Preliminary results provide insights that teachers achieved an increased awareness of the situations of students and perceived the prototype tool as useful.","PeriodicalId":350644,"journal":{"name":"2022 IEEE International Conference on Consumer Electronics (ICCE)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-01-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127885970","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Multi-Exposure Image Fusion Using Cross-Attention Mechanism","authors":"Byungnam Kim, Hyungjoo Jung, K. Sohn","doi":"10.1109/ICCE53296.2022.9730511","DOIUrl":"https://doi.org/10.1109/ICCE53296.2022.9730511","url":null,"abstract":"Multi-exposure fusion (MEF) is a popular method for obtaining high dynamic range (HDR) image from multiple low dynamic range (LDR) images. Even though recent works have employed the convolutional neural networks (CNNs) for solving the MEF problem, there still remain various challenges, such as color distortion and detail loss, due to a limited receptive field. In this paper, we present a cross-attention module for multi-exposure image fusion. Different from existing CNN-based methods that capture the contexts of the local region in the target image, our method adaptively aggregates local features with global dependencies at all positions. Furthermore, we propose a detail compensation module as the feature fusion for restoring the loss (color and detail) in the saturation region. Our proposed network performs a feature extraction with an encoder, a fusion of a cross-attention module and a detail compensation module, and the fused image is reconstructed by a decoder. Experimental results show that compared with the state-of-the-art methods, the proposed method can obtain better performance in both the subjective and objective evaluation, particularly in terms of color expression and detail-preserving.","PeriodicalId":350644,"journal":{"name":"2022 IEEE International Conference on Consumer Electronics (ICCE)","volume":"78 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-01-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125660920","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"User-Defined Keyword Spotting Utilizing Speech Synthesis for Low-Resource Wearable Devices","authors":"Jaebong Lim, Yunju Baek","doi":"10.1109/ICCE53296.2022.9730771","DOIUrl":"https://doi.org/10.1109/ICCE53296.2022.9730771","url":null,"abstract":"In this paper, we propose a novel keyword spotting (KWS) system for wearable devices that allows users to add user-defined keywords in quick and easy way. Adding keywords in KWS requires developing a new model to support them, where the model development takes a lot of work and time. To overcome this, we propose an approach that automates the entire development phase of a KWS model for low-resource devices. The proposed system is characterized by automating the data collection step and training step using synthetic speech data. Our implementation and experiments show that the proposed system can automatically develop a user-defined KWS model within a minute.","PeriodicalId":350644,"journal":{"name":"2022 IEEE International Conference on Consumer Electronics (ICCE)","volume":"54 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-01-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134041130","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Household Behavior Observation System Utilizing Mesh Sensor Network Consisting of Smart Taps","authors":"Ryuichi Inoue, Hiroshi Yamamoto","doi":"10.1109/ICCE53296.2022.9730301","DOIUrl":"https://doi.org/10.1109/ICCE53296.2022.9730301","url":null,"abstract":"In recent years, the devices focusing on the smart home have rapidly been spreading and have been expected to be applied to the services that support daily life of the residents such as the observation of daily activity of the elderly people living alone and controlling the energy efficiency. To realize the smart home, the system that can recognize daily activities of the residents with high accuracy and low cost is indispensable. The existing studies have proposed the recognition methods using various sensors such as cameras and ultrasonic sensors for estimating the living behavior. However, the existing methods have problems in terms of the privacy and installation cost. Therefore, in this study, we propose and develop a new behavior observation system that estimates daily activities of the residents by placing smart taps supporting the wireless communication on various places at home. The smart tap has a function of measuring and analyzing the power consumption of the connected devices and the received signal strength of radio waves between the smart taps. In addition, the system constructs a mesh network of the smart taps using the Thread, a type of short-range wireless communication, and the location and behavior of the residents are estimated by collecting and analyzing the measurement data. By analyzing only the measurement results of the power consumption of appliances and the received signal strength of the radio wave, the proposed system achieves accurate behavioral estimation with no privacy issues and low installation cost.","PeriodicalId":350644,"journal":{"name":"2022 IEEE International Conference on Consumer Electronics (ICCE)","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-01-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134531910","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Bruno L. M. T. Silva, Fernando S. Sousa, Gutemberg G. Santos, Danilo F. S. Santos, Marcos R. A. Morais, A. Perkusich
{"title":"A Low-Power Cryptographic Coprocessor Design for the Internet of Things","authors":"Bruno L. M. T. Silva, Fernando S. Sousa, Gutemberg G. Santos, Danilo F. S. Santos, Marcos R. A. Morais, A. Perkusich","doi":"10.1109/ICCE53296.2022.9730198","DOIUrl":"https://doi.org/10.1109/ICCE53296.2022.9730198","url":null,"abstract":"This article presents the design of a low-power cryptographic coprocessor for Internet of Things (IoT) and sensing applications based on the recharacterization of digital cells to operate below nominal voltage. The design is implemented in XFAB 180nm technology with 1V CORE voltage, achieving a 60% reduction in power and 11% in area compared to its implementation at a nominal voltage of 1.8V. This shows the effectiveness of the strategy in power optimization, allowing the use of low cost technologies to develop efficient IoT and Smart Sensors embedded systems.","PeriodicalId":350644,"journal":{"name":"2022 IEEE International Conference on Consumer Electronics (ICCE)","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-01-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134162934","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Apples vs. Oranges: The QoE Scenario in Consumer IoT Services","authors":"Tashfiq Rahman, Debajyoti Pal, Suree Funilkul, Naphongthawat Photikit","doi":"10.1109/ICCE53296.2022.9730388","DOIUrl":"https://doi.org/10.1109/ICCE53296.2022.9730388","url":null,"abstract":"IoT services are being deployed in a variety of contexts ranging from smart-homes, smart-cities, smart-healthcare, smart-transportation to smart-industry. Traditionally, Quality of Experience (QoE) that typically measures the end-users' satisfaction level with a particular service has been associated with multimedia services. In this article, we present how IoT services are unique, and why the traditional way of QoE evaluation is not a good approach in this changing scenario. There must be a paradigm shift from a user-centric approach as currently followed, to an approach that combines human to machine (H2M), and machine to machine (M2M) communications. We present a conceptual approach towards such a shift. For the consumer electronics (CE) community this article sheds light on the future research directions in evaluating the QoE for various consumer IoT services.","PeriodicalId":350644,"journal":{"name":"2022 IEEE International Conference on Consumer Electronics (ICCE)","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-01-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131495462","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Deep Neural Network Based Multi-Channel Speech Enhancement for Real-Time Voice Communication Using Smartphones","authors":"Soonho Baek, Myungho Lee, Han-gil Moon","doi":"10.1109/ICCE53296.2022.9730152","DOIUrl":"https://doi.org/10.1109/ICCE53296.2022.9730152","url":null,"abstract":"Recently, the performance of speech enhancement has been improved via deep neural networks. However, most of them are too heavy for voice communication using smartphones, and some are non-causal systems. In this paper, we introduce some effective techniques improving the performance even with light-weight models at causal system. We extract the input features by incorporating two kinds of beamformers. Furthermore, a normalization scheme is proposed to diminish the inter-channel variance between two beamformer outputs. The experimental results show the superiority of the proposed features. Moreover, the proposed method is extendable to any number of microphone systems without additional model training.","PeriodicalId":350644,"journal":{"name":"2022 IEEE International Conference on Consumer Electronics (ICCE)","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-01-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127581359","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Seungho Lim, Shin-Hyeok Kang, B. Ko, Jae-hee Roh, Chaemin Lim, Sang-Young Cho
{"title":"Architecture Exploration and Customization Tool of Deep Neural Networks for Edge Devices","authors":"Seungho Lim, Shin-Hyeok Kang, B. Ko, Jae-hee Roh, Chaemin Lim, Sang-Young Cho","doi":"10.1109/ICCE53296.2022.9730351","DOIUrl":"https://doi.org/10.1109/ICCE53296.2022.9730351","url":null,"abstract":"Recently, Deep Neural Network(DNN)-based applications are increasing in embedded edge devices. However, due to the high computational complexity, DNN has limitations in properly executing and optimizing on edge devices. As s result, DNN exploration framework is required to customize various DNN models for edge device from the software to hardware perspectives. In this paper, we provide a GUI-based framework for architectural exploration of DNN networks in edge devices. It provides software optimization such as quantization and pruning, as well as hardware performance analysis using Virtual Platform(VP)-based Deep Learning Accelerator(DLA).","PeriodicalId":350644,"journal":{"name":"2022 IEEE International Conference on Consumer Electronics (ICCE)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-01-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130727943","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}