Developing an immersive game-based learning platform with generative artificial intelligence and virtual reality technologies – “LearningverseVR”

Yanjie Song , Kaiyi Wu , Jiaoyang Ding
{"title":"Developing an immersive game-based learning platform with generative artificial intelligence and virtual reality technologies – “LearningverseVR”","authors":"Yanjie Song ,&nbsp;Kaiyi Wu ,&nbsp;Jiaoyang Ding","doi":"10.1016/j.cexr.2024.100069","DOIUrl":null,"url":null,"abstract":"<div><p>The rapid evolution of generative artificial intelligence (AI) and virtual reality (VR) technologies are revolutionising various fields, including education and gaming industries. However, studies on how to enhance immersive game-based learning with AI and VR technologies remain scant. Given this, the article presents the creation of “LearningverseVR,” an immersive game-based learning platform developed using generative AI and VR technologies, which is based on “Learningverse,” a metaverse platform developed by the lead author and her research team. The “LearningverseVR” platform uses Unity as the client and Python, Flask and MySQL as the backend. Unity's multiplayer service provides multiplayer online functionality, supporting learners to engage in immersive and interactive learning activities. The design framework of the platform consists of two main components: Game-based learning with generative AI and immersion with VR technologies. First, generative AI is used to create NPCs with diverse personalities and life backgrounds, and enable learners to interact with NPCs without scripted dialogues, creating an interactive and immersive game-based learning environment. Secondly, such a learning experience is enhanced by leveraging the Large Language Model (LLM) ecosystem with VR technology. The creation of the “LearningverseVR” platform provides novel perspectives on digital game-based learning.</p></div>","PeriodicalId":100320,"journal":{"name":"Computers & Education: X Reality","volume":"4 ","pages":"Article 100069"},"PeriodicalIF":0.0000,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2949678024000199/pdfft?md5=b5c7815c990cbacc10e7f6074f3bd423&pid=1-s2.0-S2949678024000199-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers & Education: X Reality","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2949678024000199","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

The rapid evolution of generative artificial intelligence (AI) and virtual reality (VR) technologies are revolutionising various fields, including education and gaming industries. However, studies on how to enhance immersive game-based learning with AI and VR technologies remain scant. Given this, the article presents the creation of “LearningverseVR,” an immersive game-based learning platform developed using generative AI and VR technologies, which is based on “Learningverse,” a metaverse platform developed by the lead author and her research team. The “LearningverseVR” platform uses Unity as the client and Python, Flask and MySQL as the backend. Unity's multiplayer service provides multiplayer online functionality, supporting learners to engage in immersive and interactive learning activities. The design framework of the platform consists of two main components: Game-based learning with generative AI and immersion with VR technologies. First, generative AI is used to create NPCs with diverse personalities and life backgrounds, and enable learners to interact with NPCs without scripted dialogues, creating an interactive and immersive game-based learning environment. Secondly, such a learning experience is enhanced by leveraging the Large Language Model (LLM) ecosystem with VR technology. The creation of the “LearningverseVR” platform provides novel perspectives on digital game-based learning.

利用生成式人工智能和虚拟现实技术开发基于游戏的沉浸式学习平台--"LearningverseVR"
生成式人工智能(AI)和虚拟现实(VR)技术的快速发展正在给包括教育和游戏行业在内的各个领域带来革命性的变化。然而,关于如何利用人工智能和虚拟现实技术加强沉浸式游戏学习的研究仍然很少。有鉴于此,文章介绍了 "LearningverseVR "的创建过程,这是一个利用生成式人工智能和 VR 技术开发的沉浸式游戏学习平台,它基于 "Learningverse",这是一个由主要作者及其研究团队开发的元宇宙平台。LearningverseVR "平台使用 Unity 作为客户端,Python、Flask 和 MySQL 作为后台。Unity 的多人服务提供多人在线功能,支持学习者参与沉浸式互动学习活动。该平台的设计框架由两个主要部分组成:生成式人工智能的游戏式学习和虚拟现实技术的沉浸式学习。首先,生成式人工智能用于创建具有不同个性和生活背景的 NPC,使学习者能够在没有脚本对话的情况下与 NPC 进行互动,从而创建一个交互式和沉浸式的游戏学习环境。其次,通过利用大语言模型(LLM)生态系统和 VR 技术来增强这种学习体验。LearningverseVR "平台的创建为基于数字游戏的学习提供了新的视角。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信