A novel framework for video-informed reconstructions of sports accidents: A case study correlating brain injury pattern from multimodal neuroimaging with finite element analysis
{"title":"A novel framework for video-informed reconstructions of sports accidents: A case study correlating brain injury pattern from multimodal neuroimaging with finite element analysis","authors":"Qiantailang Yuan, Xiaogai Li, Zhou Zhou, Svein Kleiven","doi":"10.1016/j.brain.2023.100085","DOIUrl":null,"url":null,"abstract":"<div><p>Ski racing is a high-risk sport for traumatic brain injury. A better understanding of the injury mechanism and the development of effective protective equipment remains central to resolving this urgency. Finite element (FE) models are useful tools for studying biomechanical responses of the brain, especially in real-world ski accidents. However, real-world accidents are often captured by handheld monocular cameras; the videos are shaky and lack depth information, making it difficult to estimate reliable impact velocities and posture which are critical for injury prediction. Introducing novel computer vision and deep learning algorithms offers an opportunity to tackle this challenge. This study proposes a novel framework for estimating impact kinematics from handheld, shaky monocular videos of accidents to inform personalized impact simulations. The utility of this framework is demonstrated by reconstructing a ski accident, in which the extracted kinematics are input to a neuroimaging-informed, personalized FE model. The FE-derived responses are compared with imaging-identified brain injury sites of the victim. The results suggest that maximum principal strain may be a useful metric for brain injury. This study demonstrates the potential of video-informed accident reconstructions combined with personalized FE modeling to evaluate individual brain injury.</p></div><div><h3>Statement of significance</h3><p>Reconstructing real-world sports accidents combined with finite element (FE) models presents a unique opportunity to study brain injuries, as it enables simulating complex loading conditions experienced in reality. However, a significant challenge lies in accurately obtaining kinematics from the often shaky, handheld video footage of such accidents. We propose a novel framework that bridges the gap between real-world accidents and video-informed injury predictions. By integrating video analysis, 3D kinematics estimation, and personalized FE simulation, we extract accurate impact kinematics of a ski accident captured from handheld shaky monocular videos to inform personalized impact simulations, predicting the injury pathology identified by multimodal neuroimaging. This study provides important guidance on how best to estimate impact conditions from video-recorded accidents, opening new opportunities to better inform the biomechanical study of head trauma with improved boundary conditions.</p></div>","PeriodicalId":72449,"journal":{"name":"Brain multiphysics","volume":"6 ","pages":"Article 100085"},"PeriodicalIF":0.0000,"publicationDate":"2023-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666522023000230/pdfft?md5=da49a10082b02cfc88996ee55d1c0486&pid=1-s2.0-S2666522023000230-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Brain multiphysics","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666522023000230","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"Engineering","Score":null,"Total":0}
引用次数: 0
Abstract
Ski racing is a high-risk sport for traumatic brain injury. A better understanding of the injury mechanism and the development of effective protective equipment remains central to resolving this urgency. Finite element (FE) models are useful tools for studying biomechanical responses of the brain, especially in real-world ski accidents. However, real-world accidents are often captured by handheld monocular cameras; the videos are shaky and lack depth information, making it difficult to estimate reliable impact velocities and posture which are critical for injury prediction. Introducing novel computer vision and deep learning algorithms offers an opportunity to tackle this challenge. This study proposes a novel framework for estimating impact kinematics from handheld, shaky monocular videos of accidents to inform personalized impact simulations. The utility of this framework is demonstrated by reconstructing a ski accident, in which the extracted kinematics are input to a neuroimaging-informed, personalized FE model. The FE-derived responses are compared with imaging-identified brain injury sites of the victim. The results suggest that maximum principal strain may be a useful metric for brain injury. This study demonstrates the potential of video-informed accident reconstructions combined with personalized FE modeling to evaluate individual brain injury.
Statement of significance
Reconstructing real-world sports accidents combined with finite element (FE) models presents a unique opportunity to study brain injuries, as it enables simulating complex loading conditions experienced in reality. However, a significant challenge lies in accurately obtaining kinematics from the often shaky, handheld video footage of such accidents. We propose a novel framework that bridges the gap between real-world accidents and video-informed injury predictions. By integrating video analysis, 3D kinematics estimation, and personalized FE simulation, we extract accurate impact kinematics of a ski accident captured from handheld shaky monocular videos to inform personalized impact simulations, predicting the injury pathology identified by multimodal neuroimaging. This study provides important guidance on how best to estimate impact conditions from video-recorded accidents, opening new opportunities to better inform the biomechanical study of head trauma with improved boundary conditions.
滑雪比赛是一项脑外伤高风险运动。更好地了解受伤机制和开发有效的防护设备仍然是解决这一紧迫问题的核心。有限元(FE)模型是研究大脑生物力学反应的有用工具,尤其是在真实世界的滑雪事故中。然而,真实世界中的事故通常是由手持式单目摄像机拍摄的;视频摇晃且缺乏深度信息,因此难以估计可靠的撞击速度和姿势,而这对于伤害预测至关重要。引入新型计算机视觉和深度学习算法为应对这一挑战提供了机会。本研究提出了一种新型框架,用于从手持、抖动的单目事故视频中估计撞击运动学,为个性化撞击模拟提供信息。通过重建一起滑雪事故,将提取的运动学信息输入到神经成像的个性化 FE 模型中,证明了该框架的实用性。FE 衍生响应与成像识别的受害者脑损伤部位进行了比较。结果表明,最大主应变可能是衡量脑损伤的有用指标。这项研究证明了视频信息事故重建与个性化 FE 模型相结合评估个体脑损伤的潜力。意义声明:将真实世界的运动事故重建与有限元(FE)模型相结合,为研究脑损伤提供了一个独特的机会,因为它可以模拟现实中经历的复杂加载条件。然而,从此类事故的手持视频录像中准确获取运动学数据是一项重大挑战。我们提出了一个新颖的框架,可弥补真实世界事故与以视频为依据的伤害预测之间的差距。通过整合视频分析、三维运动学估算和个性化 FE 模拟,我们从手持式抖动单目视频中提取了准确的滑雪事故撞击运动学信息,为个性化撞击模拟提供了依据,并预测了多模态神经影像学确定的损伤病理。这项研究为如何从视频记录的事故中最好地估计撞击条件提供了重要指导,为利用改进的边界条件更好地进行头部创伤生物力学研究提供了新的机会。