The Efficiency of Manual Editing of High-Density Surface Electromyogram Decomposition Depends on the Recorded Muscle and Contraction Level but Less on the Operator’s Experience
{"title":"The Efficiency of Manual Editing of High-Density Surface Electromyogram Decomposition Depends on the Recorded Muscle and Contraction Level but Less on the Operator’s Experience","authors":"Nina Murks;Jakob Škarabot;Matej Kramberger;Matjaž Divjak;Gašper Sedej;Tamara Valenčič;Christopher D. Connelly;Haydn Thomason;Aleš Holobar","doi":"10.1109/TNSRE.2025.3600755","DOIUrl":null,"url":null,"abstract":"We investigated the agreement and accuracy of manual editing of the high-density electromyogram (hdEMG) decomposition results by seven human operators with various experience levels. All operators edited the same automatically decomposed experimental hdEMG from the first dorsal interosseous (FDI), tibialis anterior (TA), vastus lateralis (VL), and biceps brachii (BB) muscles, and synthetic hdEMG from soleus (SO) and BB muscles at 10%, 30%, 50% and 70% of maximum voluntary contraction. On average, operators kept <inline-formula> <tex-math>$13.7~\\pm ~7.4$ </tex-math></inline-formula> motor units (MUs) after editing and demonstrated relatively large disagreement in the calculated MU pulse trains (normalized root mean square difference) but relatively high agreement in the identified MU discharges. Inter-operator agreement positively correlated with the initial MU Pulse-to-Noise Ratio used as a quality measure of automatic MU identification, and negatively correlated with the muscle contraction level. Operators agreed more on the results of the simulated than experimental hdEMG. Among the experimental muscles tested, the greatest agreement was demonstrated for VL and the lowest for BB. We obtained similar results when comparing editing to the results of the most experienced operator and to ground truth in simulated cases: the greatest precision and sensitivity were demonstrated for VL, and the lowest for BB. The level of the operator’s experience had a significant impact on the editing of synthetic hdEMG and the detection of the first MU discharge, but not on the rate of agreement or editing time of experimental hdEMG.","PeriodicalId":13419,"journal":{"name":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","volume":"33 ","pages":"3367-3376"},"PeriodicalIF":5.2000,"publicationDate":"2025-08-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11131216","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/11131216/","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0
Abstract
We investigated the agreement and accuracy of manual editing of the high-density electromyogram (hdEMG) decomposition results by seven human operators with various experience levels. All operators edited the same automatically decomposed experimental hdEMG from the first dorsal interosseous (FDI), tibialis anterior (TA), vastus lateralis (VL), and biceps brachii (BB) muscles, and synthetic hdEMG from soleus (SO) and BB muscles at 10%, 30%, 50% and 70% of maximum voluntary contraction. On average, operators kept $13.7~\pm ~7.4$ motor units (MUs) after editing and demonstrated relatively large disagreement in the calculated MU pulse trains (normalized root mean square difference) but relatively high agreement in the identified MU discharges. Inter-operator agreement positively correlated with the initial MU Pulse-to-Noise Ratio used as a quality measure of automatic MU identification, and negatively correlated with the muscle contraction level. Operators agreed more on the results of the simulated than experimental hdEMG. Among the experimental muscles tested, the greatest agreement was demonstrated for VL and the lowest for BB. We obtained similar results when comparing editing to the results of the most experienced operator and to ground truth in simulated cases: the greatest precision and sensitivity were demonstrated for VL, and the lowest for BB. The level of the operator’s experience had a significant impact on the editing of synthetic hdEMG and the detection of the first MU discharge, but not on the rate of agreement or editing time of experimental hdEMG.
我们调查了7名不同经验水平的人工编辑高密度肌电图(hdEMG)分解结果的一致性和准确性。所有操作者都编辑了相同的自动分解实验hdEMG,分别来自第一背骨间肌(FDI)、胫骨前肌(TA)、股外侧肌(VL)和肱二头肌(BB)肌肉,以及比目鱼肌(SO)和BB肌肉在最大自愿收缩10%、30%、50%和70%时的合成hdEMG。平均而言,操作人员在编辑后保留了$13.7~\pm ~7.4$ motor units (MU),并且在计算的MU脉冲序列(标准化均方根差)中显示出相对较大的差异,但在确定的MU放电中显示出相对较高的一致性。操作者之间的一致性与作为自动MU识别质量指标的初始MU脉冲噪声比正相关,与肌肉收缩水平负相关。操作人员对模拟结果的认同程度高于实验结果。在测试的实验肌肉中,VL的一致性最大,BB的一致性最低。在将编辑结果与最有经验的操作员和模拟情况下的地面真相进行比较时,我们获得了类似的结果:VL显示出最高的精度和灵敏度,BB最低。操作人员的经验水平对合成hdEMG的编辑和首次MU放电的检测有显著影响,但对实验hdEMG的一致性和编辑时间没有影响。
期刊介绍:
Rehabilitative and neural aspects of biomedical engineering, including functional electrical stimulation, acoustic dynamics, human performance measurement and analysis, nerve stimulation, electromyography, motor control and stimulation; and hardware and software applications for rehabilitation engineering and assistive devices.