Xumeng Wang;Xiao Xue;Ran Yan;Xingxia Wang;Yining Di;Wei Chen;Fei-Yue Wang
{"title":"Sora for Intelligent Vehicles: A Step From Constraint-Based Simulation to Artificiofactual Experiments Through Dynamic Visualization","authors":"Xumeng Wang;Xiao Xue;Ran Yan;Xingxia Wang;Yining Di;Wei Chen;Fei-Yue Wang","doi":"10.1109/TIV.2024.3384550","DOIUrl":null,"url":null,"abstract":"Scenario simulation plays an integral role in the development, application, and management of intelligent vehicles. However, planning agents and customizing scenarios for complex systems are laborious, making it challenging to implement high-performance simulations. The striking progress made by Sora, a large-scale text-to-video model, suggests a research opportunity for high-performance simulation through dynamic visualizations. This paper reports the prospective effects of Sora on the scenario simulation of intelligent vehicles. Specifically, we review the achievements of Sora, picture the perspectives of artificiofactual experiments on intelligent vehicles based on the performance of Sora-type techniques, and discuss how far are we now.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 3","pages":"4249-4253"},"PeriodicalIF":14.0000,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Intelligent Vehicles","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10490253/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Scenario simulation plays an integral role in the development, application, and management of intelligent vehicles. However, planning agents and customizing scenarios for complex systems are laborious, making it challenging to implement high-performance simulations. The striking progress made by Sora, a large-scale text-to-video model, suggests a research opportunity for high-performance simulation through dynamic visualizations. This paper reports the prospective effects of Sora on the scenario simulation of intelligent vehicles. Specifically, we review the achievements of Sora, picture the perspectives of artificiofactual experiments on intelligent vehicles based on the performance of Sora-type techniques, and discuss how far are we now.
情景模拟在智能汽车的开发、应用和管理中发挥着不可或缺的作用。然而,为复杂系统规划代理和定制情景非常费力,因此实现高性能仿真具有挑战性。大规模文本到视频模型 Sora 取得的显著进展为通过动态可视化实现高性能仿真提供了研究机会。本文报告了 Sora 对智能汽车场景仿真的前瞻性影响。具体而言,我们回顾了 Sora 所取得的成就,描绘了基于 Sora 类技术性能的智能车辆人工智能实验的前景,并讨论了目前的进展情况。
期刊介绍:
The IEEE Transactions on Intelligent Vehicles (T-IV) is a premier platform for publishing peer-reviewed articles that present innovative research concepts, application results, significant theoretical findings, and application case studies in the field of intelligent vehicles. With a particular emphasis on automated vehicles within roadway environments, T-IV aims to raise awareness of pressing research and application challenges.
Our focus is on providing critical information to the intelligent vehicle community, serving as a dissemination vehicle for IEEE ITS Society members and others interested in learning about the state-of-the-art developments and progress in research and applications related to intelligent vehicles. Join us in advancing knowledge and innovation in this dynamic field.