基于混合现实的多栋建筑虚拟大曲面屏幕交互效果实现

Yilan Zhou, Yue Zhang, Shanzhen Lan, Shaobin Li
{"title":"基于混合现实的多栋建筑虚拟大曲面屏幕交互效果实现","authors":"Yilan Zhou, Yue Zhang, Shanzhen Lan, Shaobin Li","doi":"10.1109/cost57098.2022.00038","DOIUrl":null,"url":null,"abstract":"The glass-free three dimensional (3D) large screen has provided an ultra-sensory immersive visual experience, and broken the aesthetic fatigue of people to print advertising. But it’s also limited by the geographical location and high cost of installation, accordingly, the virtual large curved screens on multiple buildings with interaction effect based on mixed reality (MR) was designed and implemented in this paper. Firstly, the deep learning building detection and building surface recognition algorithm were adopted to recognize the building surfaces, and the recognized surfaces were further filtered and integrated, which then completed the positioning of multiple buildings virtual large screens based on the integrated multiple plane groups. Based on the simultaneous rendering of multiple virtual curved screens, several interaction modes were also designed between the large screen spaces, thus furtherly enhancing the user experience and application potential of the virtual curved screens. The overall program built modularly based on 3D engine achieves better recognition, rendering and interaction effects in mobile, which also provides new ideas for new forms of MR applications in urban environments.","PeriodicalId":135595,"journal":{"name":"2022 International Conference on Culture-Oriented Science and Technology (CoST)","volume":"31 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Implementation of the Interaction Effect Among Virtual Large Curved Screens on Multiple Buildings Based on Mixed Reality\",\"authors\":\"Yilan Zhou, Yue Zhang, Shanzhen Lan, Shaobin Li\",\"doi\":\"10.1109/cost57098.2022.00038\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The glass-free three dimensional (3D) large screen has provided an ultra-sensory immersive visual experience, and broken the aesthetic fatigue of people to print advertising. But it’s also limited by the geographical location and high cost of installation, accordingly, the virtual large curved screens on multiple buildings with interaction effect based on mixed reality (MR) was designed and implemented in this paper. Firstly, the deep learning building detection and building surface recognition algorithm were adopted to recognize the building surfaces, and the recognized surfaces were further filtered and integrated, which then completed the positioning of multiple buildings virtual large screens based on the integrated multiple plane groups. Based on the simultaneous rendering of multiple virtual curved screens, several interaction modes were also designed between the large screen spaces, thus furtherly enhancing the user experience and application potential of the virtual curved screens. The overall program built modularly based on 3D engine achieves better recognition, rendering and interaction effects in mobile, which also provides new ideas for new forms of MR applications in urban environments.\",\"PeriodicalId\":135595,\"journal\":{\"name\":\"2022 International Conference on Culture-Oriented Science and Technology (CoST)\",\"volume\":\"31 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 International Conference on Culture-Oriented Science and Technology (CoST)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/cost57098.2022.00038\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 International Conference on Culture-Oriented Science and Technology (CoST)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/cost57098.2022.00038","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

无玻璃的三维(3D)大屏幕提供了超感官的沉浸式视觉体验,打破了人们对平面广告的审美疲劳。但受地理位置和安装成本的限制,本文设计并实现了基于混合现实(MR)的具有交互效果的多建筑虚拟大曲面屏幕。首先,采用深度学习建筑检测和建筑表面识别算法对建筑表面进行识别,并对识别出的表面进行进一步的过滤和整合,基于整合的多平面组完成多栋建筑虚拟大屏幕的定位。在多个虚拟曲面屏幕同时呈现的基础上,设计了大屏幕空间之间的多种交互模式,进一步提升了虚拟曲面屏幕的用户体验和应用潜力。基于3D引擎模块化构建的整体方案在移动端实现了更好的识别、渲染和交互效果,也为MR在城市环境中的新形式应用提供了新思路。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Implementation of the Interaction Effect Among Virtual Large Curved Screens on Multiple Buildings Based on Mixed Reality
The glass-free three dimensional (3D) large screen has provided an ultra-sensory immersive visual experience, and broken the aesthetic fatigue of people to print advertising. But it’s also limited by the geographical location and high cost of installation, accordingly, the virtual large curved screens on multiple buildings with interaction effect based on mixed reality (MR) was designed and implemented in this paper. Firstly, the deep learning building detection and building surface recognition algorithm were adopted to recognize the building surfaces, and the recognized surfaces were further filtered and integrated, which then completed the positioning of multiple buildings virtual large screens based on the integrated multiple plane groups. Based on the simultaneous rendering of multiple virtual curved screens, several interaction modes were also designed between the large screen spaces, thus furtherly enhancing the user experience and application potential of the virtual curved screens. The overall program built modularly based on 3D engine achieves better recognition, rendering and interaction effects in mobile, which also provides new ideas for new forms of MR applications in urban environments.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信