{"title":"A Quick Review of Human Perception in Immersive Media","authors":"Huiyu Duan;Xilei Zhu;Yuxin Zhu;Xiongkuo Min;Guangtao Zhai","doi":"10.1109/OJID.2024.3351089","DOIUrl":"https://doi.org/10.1109/OJID.2024.3351089","url":null,"abstract":"With the development of multimedia and information technology, immersive media has been increasingly popular and attracted great attention. The concept of immersive media includes Virtual Reality (VR), Augmented Reality (AR), Mixed Reality (MR), 3D content, etc., which aims to provide or introduce immersive experience to the real-word through influencing human perception. Accordingly, recent years have witnessed an explosion of the literature on human perception in immersive media, including visual perception, auditory perception, etc. In this paper, we review the state-of-the-art works on studying human perception in immersive media and discuss corresponding applications. First, this paper reviews the perception attention studies of immersive media from the aspects of visual attention and multi-modal attention. Second, we survey the subjective and objective perceptual quality studies of immersive media including both visual quality assessment and multi-modal quality assesment. Finally, we overview the human perception properties in immersive media and outlook the future trends.","PeriodicalId":100634,"journal":{"name":"IEEE Open Journal on Immersive Displays","volume":"1 ","pages":"41-50"},"PeriodicalIF":0.0,"publicationDate":"2024-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10384639","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139654741","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Tengteng Lei;Runxiao Shi;Zong Liu;Yushen Hu;Man Wong
{"title":"Neuromorphic Sensor-Perception Systems for Immersive Displays","authors":"Tengteng Lei;Runxiao Shi;Zong Liu;Yushen Hu;Man Wong","doi":"10.1109/OJID.2023.3343309","DOIUrl":"https://doi.org/10.1109/OJID.2023.3343309","url":null,"abstract":"An immersive display implementing enhanced virtual and augmented reality demands a higher level of human-machine interaction and requires input from a variety of sensors that monitor human activities. However, the processing of a large volume of sensory data challenges the classical von Neumann computing architecture in terms of latency and energy efficiency. Made possible by the sharing of a common metal-oxide (MO) thin-film transistor (TFT) technology, the monolithic integration of a sensor array and a neuromorphic signal processor has been reported as an approach to meeting such requirement. Reviewed presently is the realization of an analog front-end human-machine interfacing system and its application to the acquisition of bio-potential signals. Active-matrix chemical and tactile sensor arrays integrated with biomimetic artificial neural networks based on dual-gate MO TFTs for neuromorphic signal processing are described. Finally, the challenges and prospects of enhanced neuromorphic sensor-perception systems for immersive displays are discussed.","PeriodicalId":100634,"journal":{"name":"IEEE Open Journal on Immersive Displays","volume":"1 ","pages":"20-27"},"PeriodicalIF":0.0,"publicationDate":"2023-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10360208","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139060213","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jeong-Wan Jo;Yoonwoo Kim;Jiajie Yang;Sanghyo Lee;SUNG-MIN JUNG;Luigi Giuseppe Occhipinti;Jong Min Kim
{"title":"High Picture Quality Quantum-Dot Light-Emitting Diode Display Technologies for Immersive Displays","authors":"Jeong-Wan Jo;Yoonwoo Kim;Jiajie Yang;Sanghyo Lee;SUNG-MIN JUNG;Luigi Giuseppe Occhipinti;Jong Min Kim","doi":"10.1109/OJID.2023.3342769","DOIUrl":"https://doi.org/10.1109/OJID.2023.3342769","url":null,"abstract":"High-resolution microdisplays that offer superior picture quality are pivotal display components in immersive augmented reality (AR) and virtual reality (VR) systems. For AR and VR applications, the microdisplays must satisfy major requirements such as high resolution, exceptional brightness, and a broad color gamut to ensure clear and vivid picture quality. Quantum-dot light-emitting diodes (QD-LEDs) are emerging light sources due to their outstanding color purity and controllability. Rapid advancements in QD materials and device technologies suggest the potential industrialization of QD-LED displays in the near future. Moreover, recent innovation in the process technology of patterning QD layers enables the formation of ultrahigh-resolution QD-LED pixels for microdisplays, promising immersive and brighter visual experiences in AR and VR applications. In this study, we review the latest QD-LED technologies from QD material advancements and device architecture optimization to the pixelization process and integration of full-color display systems. Advancements in QD-LED display technology will enable the realization of high picture quality QD-LED microdisplays for extremely immersive AR and VR display systems.","PeriodicalId":100634,"journal":{"name":"IEEE Open Journal on Immersive Displays","volume":"1 ","pages":"9-19"},"PeriodicalIF":0.0,"publicationDate":"2023-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10356854","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139060270","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Electronic Skin for Virtual Sensation Generation in Immersive Virtual and Augmented Reality","authors":"Jiaqi Wang;Shuo Gao","doi":"10.1109/OJID.2023.3340662","DOIUrl":"https://doi.org/10.1109/OJID.2023.3340662","url":null,"abstract":"Virtual Reality (VR) and Augmented Reality (AR) have revolutionized digital content interaction. To achieve immersive interaction experiences, multi-sensory input is essential. Electronic skin (e-skin) compensates for the lack of sensory experience beyond visual and auditory senses with its characteristics of compact, lightweight, highly flexible, and adhering seamlessly to the body. This review comprehensively summarizes the recent progress in the virtual sensations generation of e-skin including tactile, thermal, olfactory, and directional perceptions within the AR/VR landscape. The detailed applications of these e-skins involve virtual touch via social media, the feel of being hit during the game, remote surface texture and object shape recognition, generating virtual minty and lemon, etc. E-skin has emerged as a game-changing technology in the realms of VR and AR, enhancing immersion and interaction through touchless interactions and various virtual sensations. These evolutions promise to further bridge the physical and virtual worlds, transforming our AR/VR experiences in the future.","PeriodicalId":100634,"journal":{"name":"IEEE Open Journal on Immersive Displays","volume":"1 ","pages":"1-8"},"PeriodicalIF":0.0,"publicationDate":"2023-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10350059","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139050590","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Frontcover","authors":"","doi":"10.1109/OJID.2023.3290382","DOIUrl":"https://doi.org/10.1109/OJID.2023.3290382","url":null,"abstract":"","PeriodicalId":100634,"journal":{"name":"IEEE Open Journal on Immersive Displays","volume":"1 ","pages":"C1-C1"},"PeriodicalIF":0.0,"publicationDate":"2023-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/10053844/10223446/10223467.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50327148","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}