The best angle correction of basketball shooting based on the fusion of time series features and dual CNN

IF 5 3区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Meicai Xiao
{"title":"The best angle correction of basketball shooting based on the fusion of time series features and dual CNN","authors":"Meicai Xiao","doi":"10.1016/j.eij.2024.100579","DOIUrl":null,"url":null,"abstract":"<div><div>The best shooting angle correction of basketball based on intelligent image analysis is an important branch of the development of intelligent sports. However, the current method is limited by the variability of the shape base, ignoring dynamic features and visual information, and there are some problems in the process of feature extraction and correction of related actions. This paper proposes a method to correct the best shooting angle of basketball based on the fusion of time series characteristics and dual CNN. Segmenting the shooting video, taking the video frame as the input of the key node extraction network of the shooting action, obtaining the video frame with the sequence information of the bone points, extracting the continuous T-frame video stack from it, and inputting it into the spatial context feature extraction network in the shooting posture prediction model based on dual stream CNN (MobileNet V3 network with multi-channel attention mechanism fusion module), extract the space context features of shooting posture; The superimposed optical flow graph of continuous video frames containing sequence information of bone points is input into the time convolution network (combined with Bi-LSTM network of multi-channel attention mechanism fusion module), extract the skeleton temporal sequence features during the shooting movement, using the spatial context features and skeleton temporal sequence features extracted from the feature fusion module, and realizing the prediction of shooting posture through Softmax according to the fusion results, calculate the shooting release speed under this attitude, solve the shooting release angle, and complete the correction of the best shooting release angle by comparing with the set conditions. The experimental results show that this method can achieve the best shooting angle correction, and the training learning rate is 0.2 × 10–3, training loss is about 0.05; MPJPE and MPJVE indicators are the lowest, and Top-1 indicators are the highest; The shooting percentage is about 95 %.</div></div>","PeriodicalId":56010,"journal":{"name":"Egyptian Informatics Journal","volume":"28 ","pages":"Article 100579"},"PeriodicalIF":5.0000,"publicationDate":"2024-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Egyptian Informatics Journal","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1110866524001427","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

The best shooting angle correction of basketball based on intelligent image analysis is an important branch of the development of intelligent sports. However, the current method is limited by the variability of the shape base, ignoring dynamic features and visual information, and there are some problems in the process of feature extraction and correction of related actions. This paper proposes a method to correct the best shooting angle of basketball based on the fusion of time series characteristics and dual CNN. Segmenting the shooting video, taking the video frame as the input of the key node extraction network of the shooting action, obtaining the video frame with the sequence information of the bone points, extracting the continuous T-frame video stack from it, and inputting it into the spatial context feature extraction network in the shooting posture prediction model based on dual stream CNN (MobileNet V3 network with multi-channel attention mechanism fusion module), extract the space context features of shooting posture; The superimposed optical flow graph of continuous video frames containing sequence information of bone points is input into the time convolution network (combined with Bi-LSTM network of multi-channel attention mechanism fusion module), extract the skeleton temporal sequence features during the shooting movement, using the spatial context features and skeleton temporal sequence features extracted from the feature fusion module, and realizing the prediction of shooting posture through Softmax according to the fusion results, calculate the shooting release speed under this attitude, solve the shooting release angle, and complete the correction of the best shooting release angle by comparing with the set conditions. The experimental results show that this method can achieve the best shooting angle correction, and the training learning rate is 0.2 × 10–3, training loss is about 0.05; MPJPE and MPJVE indicators are the lowest, and Top-1 indicators are the highest; The shooting percentage is about 95 %.
基于时间序列特征和双 CNN 融合的篮球投篮最佳角度校正
基于智能图像分析的篮球最佳投篮角度修正是智能体育发展的一个重要分支。然而,目前的方法受限于形状基础的可变性,忽略了动态特征和视觉信息,在特征提取和相关动作修正过程中存在一些问题。本文提出了一种基于时间序列特征和双 CNN 融合的篮球最佳投篮角度修正方法。对投篮视频进行分割,将视频帧作为投篮动作关键节点提取网络的输入,获取带有骨点序列信息的视频帧,从中提取连续的T帧视频栈,并将其输入基于双流CNN(MobileNet V3网络与多通道注意机制融合模块)的投篮姿势预测模型中的空间上下文特征提取网络,提取投篮姿势的空间上下文特征;将包含骨点序列信息的连续视频帧叠加光流图输入时间卷积网络(结合多通道注意机制融合模块的 Bi-LSTM 网络),提取射击运动过程中的骨架时间序列特征、利用特征融合模块提取的空间上下文特征和骨骼时序特征,根据融合结果通过 Softmax 实现射击姿态预测,计算该姿态下的射击释放速度,求解射击释放角度,并通过与设定条件的比较完成最佳射击释放角度的修正。实验结果表明,该方法可实现最佳投篮角度修正,训练学习率为0.2×10-3,训练损失约为0.05;MPJPE和MPJVE指标最低,Top-1指标最高;投篮命中率约为95%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Egyptian Informatics Journal
Egyptian Informatics Journal Decision Sciences-Management Science and Operations Research
CiteScore
11.10
自引率
1.90%
发文量
59
审稿时长
110 days
期刊介绍: The Egyptian Informatics Journal is published by the Faculty of Computers and Artificial Intelligence, Cairo University. This Journal provides a forum for the state-of-the-art research and development in the fields of computing, including computer sciences, information technologies, information systems, operations research and decision support. Innovative and not-previously-published work in subjects covered by the Journal is encouraged to be submitted, whether from academic, research or commercial sources.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信