{"title":"Eye-Tracking in AR/VR: A Technological Review and Future Directions","authors":"Xin Jin;Suyu Chai;Jie Tang;Xianda Zhou;Kai Wang","doi":"10.1109/OJID.2024.3450657","DOIUrl":"https://doi.org/10.1109/OJID.2024.3450657","url":null,"abstract":"With the rapid development of augmented reality (AR) and virtual reality (VR) applications, eye-tracking as a natural yet intuitive human-machine interface technology has become increasingly important and necessary. This review provides a comprehensive overview of approaches, technological advancements, application scenarios, and challenges of various eye-tracking technologies particularly for AR/VRs. After briefly discussing the fundamental principles of eye-tracking technology and its implementation in AR/VR devices, we have reviewed the major technological breakthroughs and innovations in this field in the recent years. We also make specific cases of eye-tracking technology in various AR/VR applications, such as user interface optimization, gaze interaction, immersive experience enhancement, and health monitoring. Lastly, technical challenges such as insufficient accuracy, high computational resource consumption, and privacy concerns together with future development directions of eye-tracking technology, have been addressed.","PeriodicalId":100634,"journal":{"name":"IEEE Open Journal on Immersive Displays","volume":"1 ","pages":"146-154"},"PeriodicalIF":0.0,"publicationDate":"2024-08-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10652231","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142320489","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Shan Huang;Feng Feng;Zichun Li;Yibo Liu;Man Hoi Wong;Hoi Sing Kwok;Zhaojun Liu
{"title":"Advances in Full-Color Microdisplays Based on MicroLED for AR and VR Applications","authors":"Shan Huang;Feng Feng;Zichun Li;Yibo Liu;Man Hoi Wong;Hoi Sing Kwok;Zhaojun Liu","doi":"10.1109/OJID.2024.3446761","DOIUrl":"https://doi.org/10.1109/OJID.2024.3446761","url":null,"abstract":"With the continuous proliferation of augmented reality (AR) and virtual reality (VR) technologies, especially as their applications expand across entertainment, education, healthcare, and industrial sectors, the demand for full-color microdisplays based on micro-light-emitting diodes (MicroLEDs) is expected to grow significantly. This paper reviews the latest advancements in achieving full-color microdisplays, particularly those utilizing MicroLED technology and summarizes the methods employed by various research groups in recent years to better meet the display requirements of AR/VR devices. These methods include mass transfer technology, quantum dot color conversion technology, multi-material epitaxial layer stacking technology, JBD's x-cube technology, and several other emerging technologies. These approaches provide feasible technological pathways for the realization of full-color microdisplays and offer valuable references for the future development of MicroLED-based full-color microdisplays.","PeriodicalId":100634,"journal":{"name":"IEEE Open Journal on Immersive Displays","volume":"1 ","pages":"127-134"},"PeriodicalIF":0.0,"publicationDate":"2024-08-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10640191","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142246372","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Photo-Synaptic Pixel Circuit for Artificial Retina With Organic Thin-Film Transistors","authors":"Yixun Hu;Yishen Sun;Yilun Zhong;Jian Zhao;Chenxin Zhu;Chen Jiang","doi":"10.1109/OJID.2024.3445340","DOIUrl":"https://doi.org/10.1109/OJID.2024.3445340","url":null,"abstract":"Photo-synaptic receptors emulating the natural biological photodetectors in human retina are required to build artificial visual perceptional systems as a new solution for augmented reality. Biological photoreceptors transform continuous light illumination into pulse-train like frequency-modulated signals. However, state-of-art photo-synaptic electronic devices are only capable of transforming light pulse signals into synaptic current signals without mimicking biological photodetectors. Here, a photo-synaptic pixel circuit (PSPC) for artificial retina with organic thin-film transistors (OTFTs) is reported to demonstrate a frequency-modulated spiking signals output responding to continuous light illumination. The reported PSPC is supposed to smooth the way for biomimetic photoreceptor arrays served as an artificial retina. In this work, photo-sensing is achieved by building a PSPC with phototransistors using indacenodithiophene-benzothiadiazole (IDT-BT) as the active layer. By applying continuous light illumination intensities ranging from 0 W/m\u0000<sup>2</sup>\u0000 to 2.7 W/m\u0000<sup>2</sup>\u0000 (to mimic the standard indoor intensity around 1 W/m\u0000<sup>2</sup>\u0000), the frequency of the photo-synaptic pixel circuit output is modulated from 416 Hz to 990 Hz, with a positive correlation between input light intensity and output signal frequency. This work provides a photodetector with continuous photo-sensing, with a biomimetic conversion of light intensity to frequency-modulated signals.","PeriodicalId":100634,"journal":{"name":"IEEE Open Journal on Immersive Displays","volume":"1 ","pages":"119-126"},"PeriodicalIF":0.0,"publicationDate":"2024-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10638747","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142246529","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Subjective and Objective Quality Assessment for Augmented Reality Images","authors":"Pengfei Wang;Huiyu Duan;Zongyi Xie;Xiongkuo Min;Guangtao Zhai","doi":"10.1109/OJID.2024.3441511","DOIUrl":"https://doi.org/10.1109/OJID.2024.3441511","url":null,"abstract":"Extended Reality (XR), including Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR), has rapidly advanced, offering immersive experiences to users. Among these technologies, AR has gained prominence for seamlessly integrating virtual and real-world scenes, enabling the augmented experience. However, assessing the quality of AR images remains a critical challenge for the lack of investigation on the interaction between the virtual-world contents and real-world scenes in real cases. In this work, we construct an AR image quality assessment database in real applications based on an AR HMD. Then we analyze the subjective quality ratings in real AR environments and perform objective quality assessment using state-of-the-art models. This comprehensive subjective and objective analysis enhance our understanding of the Quality of Experience (QoE) in AR.","PeriodicalId":100634,"journal":{"name":"IEEE Open Journal on Immersive Displays","volume":"1 ","pages":"135-145"},"PeriodicalIF":0.0,"publicationDate":"2024-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10632616","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142246530","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Thin-Film Transistor Technologies and Compensation Schemes for Active-Matrix LED Displays","authors":"Li'Ang Deng;Yu Huang;Bang Ouyang;Rongrong Shi;Weihong Yang;Zikang Mei;Hongbang Wu;Gufeng He;Arokia Nathan;Xiaojun Guo","doi":"10.1109/OJID.2024.3367068","DOIUrl":"https://doi.org/10.1109/OJID.2024.3367068","url":null,"abstract":"Various light emitting diode (LED) technologies have been developed for immersive displays. The continuous demands on improvement of display quality, particularly for immersive applications, imposes significant challenges and even more strict requirements in terms of the thin-film transistor (TFT) backplane. This is especially true with organic LED (OLED) for large size panels and micro-LEDs which is undergoing a surge in development to cope with new applications. This paper reviews the two key TFT display backplane technologies for high-end displays along with pertinent driving schemes. The technical challenges for further development are discussed.","PeriodicalId":100634,"journal":{"name":"IEEE Open Journal on Immersive Displays","volume":"1 ","pages":"95-105"},"PeriodicalIF":0.0,"publicationDate":"2024-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10496917","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140639415","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Towards Immersive Human-Machine Interfaces: Sensing, Computing and Displaying","authors":"Runchuan Ma;Rui Li;Hao Gong;Shengbiao Hu;Haowen Zhao;Xiaojun Guo","doi":"10.1109/OJID.2024.3384141","DOIUrl":"https://doi.org/10.1109/OJID.2024.3384141","url":null,"abstract":"It is of great promise to achieve immersive experience with display-based human-machine interfaces (HMIs) for various end devices ranging from smart phones, PADs to various types of spatial computing devices. This paper reviews the key technologies and challenges in the three key steps of sensing, computing, and displaying for achieving immersive HMI systems. Development of various sensing technologies enables accurate recognition of input information from human. Meanwhile, sensing and reconstruction of the surrounding environment, including 3D scene and other related information, is also key. To overcome the constraints of energy and hardware, near-/in-sensor computing and edge-cloud collaborative computing can be adopted to minimize the requirement of local computational resources. As the final step, the system must be able to display a updated scene with visual and other related information in real-time for the user to perceive with immersive experience. In addition to continuous efforts on key components, system-level design and new heterogenous integration or packaging techniques for physically realizing compact “sense-compute-display” systems with less data transmission and more efficient computation are demanded.","PeriodicalId":100634,"journal":{"name":"IEEE Open Journal on Immersive Displays","volume":"1 ","pages":"86-94"},"PeriodicalIF":0.0,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10487864","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140559316","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An Introduction to Immersive Display Technologies","authors":"Kai Wang;Weikang Yan","doi":"10.1109/OJID.2024.3383373","DOIUrl":"https://doi.org/10.1109/OJID.2024.3383373","url":null,"abstract":"Metaverse applications have led to rapid developments in information display, in particular, immersive display. There have been a few immersive display devices on the market to meet various application scenarios both indoors and outdoors. This paper overviews current immersive display technologies including binocular stereo and naked-eye stereo types and addresses limitations those technologies face. To meet the fast-growing demand on immersive displays in the future, research and development efforts on enabling display device technologies and associated optics are discussed.","PeriodicalId":100634,"journal":{"name":"IEEE Open Journal on Immersive Displays","volume":"1 ","pages":"79-85"},"PeriodicalIF":0.0,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10487022","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140548494","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Editorial Welcome to the New IEEE Open Journal on Immersive Displays","authors":"Arokia Nathan","doi":"10.1109/OJID.2024.3387033","DOIUrl":"https://doi.org/10.1109/OJID.2024.3387033","url":null,"abstract":"Dear readers, it is my great pleasure to introduce you to the new \u0000<sc>IEEE Open Journal on Immersive Displays</small>\u0000 (OJ-ID). It is a gold open-access, fully electronic scientific journal publishing papers in immersive display science and applications integral to technologies advancing the Metaverse. The journal's mission is to provide the immersive display science and applications community with a high-quality, peer-reviewed journal that fosters technological innovation and excellence while meeting author needs to publish within their funding requirements.","PeriodicalId":100634,"journal":{"name":"IEEE Open Journal on Immersive Displays","volume":"1 ","pages":"106-106"},"PeriodicalIF":0.0,"publicationDate":"2024-03-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10532215","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140952465","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Display and Optics Architecture for Meta's AR/VR Development","authors":"Linghui Rao;Naamah Argaman;Jim Zhuang;Ajit Ninan;Cheonhong Kim;Daozhi Wang;Shizhe Shen","doi":"10.1109/OJID.2024.3370888","DOIUrl":"https://doi.org/10.1109/OJID.2024.3370888","url":null,"abstract":"We believe in the future of connection in the metaverse. The addition of immersive technologies such as augmented reality (AR) and virtual reality (VR) is the next step in this progression. In this paper, we will provide an overview of Meta's progress in display and optics development for AR and VR. The overview will cover different architectures that may lead to wide adoption of AR and VR devices in the near future as well as solutions that will mature over time. We will also discuss different components maturity and utilizing human perception for building systems made for human vision.","PeriodicalId":100634,"journal":{"name":"IEEE Open Journal on Immersive Displays","volume":"1 ","pages":"71-78"},"PeriodicalIF":0.0,"publicationDate":"2024-02-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10452750","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140123392","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Zichun Li;Yibo Liu;Feng Feng;Zhaoyong Liu;Man Wong;Hoi Sing Kwok;Zhaojun Liu
{"title":"Advancements in InGaN-Based Red Micro-LEDs","authors":"Zichun Li;Yibo Liu;Feng Feng;Zhaoyong Liu;Man Wong;Hoi Sing Kwok;Zhaojun Liu","doi":"10.1109/OJID.2024.3368374","DOIUrl":"https://doi.org/10.1109/OJID.2024.3368374","url":null,"abstract":"Micro-LEDs have emerged as a promising fourth generation display technology with many advantages over traditional displays. However, the mass production of micro-LEDs still faces challenges, particularly in the production of high-quality red micro-LEDs. Low efficiency red micro-LEDs are a major challenge that needs to be overcome. In this paper, we focus on recent advancements in improving the device performance of InGaN-based red micro-LEDs. We summarize the various approaches taken by research groups in recent years to improve the efficiency and performance of red micro-LEDs at both the epitaxial and process levels. These include the use of InGaNOS substrates, increasing the density of V-shaped pits and other methods to improve crystal quality, the incorporation of nanostructures to enhance light extraction efficiency, and the optimization of fabrication processes to reduce defects and improve uniformity. These approaches have resulted in significant improvements in the efficiency and performance of red micro-LEDs. Despite these efforts, the development of efficient and reliable red micro-LEDs remains a critical challenge. Further research is needed to address the fundamental material and device physics underlying the performance limitations of red micro-LEDs.","PeriodicalId":100634,"journal":{"name":"IEEE Open Journal on Immersive Displays","volume":"1 ","pages":"62-70"},"PeriodicalIF":0.0,"publicationDate":"2024-02-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10443013","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140123318","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}