Response to the Letter to the Editor regarding the meta-analytic evidence on age-stratified ACL repair outcomes, with a commentary on reporting beyond the evidence hierarchy

IF 5 2区 医学 Q1 ORTHOPEDICS
Sebastian Conner-Rilk, Jelle P. van der List, Gregory S. DiFelice
{"title":"Response to the Letter to the Editor regarding the meta-analytic evidence on age-stratified ACL repair outcomes, with a commentary on reporting beyond the evidence hierarchy","authors":"Sebastian Conner-Rilk,&nbsp;Jelle P. van der List,&nbsp;Gregory S. DiFelice","doi":"10.1002/ksa.12735","DOIUrl":null,"url":null,"abstract":"<p>We would like to thank Rao and Yang for their interest in our article, ‘Anterior cruciate ligament primary repair revision rates are increased in skeletally mature patients under the age of 21 compared to reconstruction, while adults (&gt;21 years) show no significant difference: a systematic review and meta-analysis’ [<span>19</span>]. We appreciate their recognition of our methodology and the clinical relevance of our findings.</p><p>While we welcome their critique, many of the points raised in their letter to the editor [<span>32</span>] reflect limitations we acknowledged and addressed in our manuscript. Some concerns appear to rise from incorrect interpretations or may not fully consider aspects of our analysis. In this response, we aim to clarify key points and further explain our rationale in a constructive scientific exchange.</p><p>We acknowledge the general limitations of meta-analyses, especially in a field like anterior cruciate ligament (ACL) repair where clinical adoption is evolving and high-level evidence remains limited. Accordingly, sound study design and transparent reporting are essential. Our study aimed to navigate the challenges of synthesising data from a developing field and acknowledged the predominance of retrospective designs and demographic heterogeneity. To address these limitations, we: (1) restricted inclusion to Level I–III for greater evidence homogeneity; (2) contacted all study authors for unpublished demographic and outcome data, improving data quality and enabling subgroup analyses and (3) performed an extensive risk-of-bias analysis to support a balanced discussion of current strengths and limitations. Despite these efforts, as stated in our manuscript, selection and publication bias remain possible. However, a systematic review by two independent reviewers ensured comprehensive inclusion of eligible recent studies. In response to the suggestion that ‘future meta-analyses should expand the literature search, including more high-quality prospective studies’, we would have welcomed references to specific overlooked studies to improve future analyses and the ongoing scientific dialogue.</p><p>Regarding the critique that the meta-analysis did not adequately explore heterogeneity and bias, and tools such as Egger's test [<span>7</span>] should have been included, we refer readers to our results section ‘Level of Evidence and Risk of Bias Assessment’, specifically figs. 6–7 and tabs. 9–10, which include funnel plots, Egger's test, and assessments using both RoB 2 [<span>23</span>] and MINORS tools [<span>22</span>]. The risk of bias analysis was even performed by two evaluators and to assess reliability of the rating the inter-rater reliability was calculated and presented as excellent for both the MINORS and Rob 2 assessments, with 0.8 and 0.9, respectively. We believe the authors have missed this in our study.</p><p>Rao and Yang also state that ‘the interpretation of certain unexpected findings lacks depth’. However, the higher revision rates in patients ≤21 years were not unexpected. This threshold was previously defined by Vermeijden et al. [<span>31</span>] and confirmed by Ferreira et al. [<span>8</span>] in matched cohort studies comparing ACL repair and reconstruction. Similarly, elevated reoperation rates due to removal of hardware have been reported for ACL repair using the dynamic intraligamentary stabilization (DIS) implant [<span>2, 10, 12, 14</span>], while ACL primary repair (ACLPR) and repair with the bridge enhanced ACL restoration (BEAR) scaffold have generally shown lower rates [<span>6, 8, 9, 13, 17</span>]. Notably, no prior review has stratified revision and reoperation rates by age and surgical technique across ACLPR, DIS, and BEAR. This stratified, technique-specific approach constitutes the novelty of our work. Furthermore, the comment of lack of depth in our analysis seems surprising as our meta-analysis has uniquely contacted the authors of the included studies, obtained full datasets when available, and performed rigorous meta-analyses beyond the standard meta-analyses published in the orthopaedic literature.</p><p>More specifically on the authors' comment regarding the higher reoperation rates following DIS, van der List et al. [<span>25</span>] suggest possible confounders such as selection bias and the surgeon's learning curve. While we agree these may contribute, the learning curve is a known limitation of all new surgical methods, including ACLPR and BEAR. Crucially, strong evidence links the DIS implant's design to higher reoperation risk [<span>2, 10, 12, 14</span>]. Moreover, the release of a second-generation, smaller implant by the manufacturer supports the view that implant-specific issues significantly contributed to these outcomes.</p><p>We also appreciate the mention of biological and behavioural factors in younger patients—such as more advanced ACL degeneration, higher postoperative activity, and metabolic differences. While important, these factors were outside our study's scope and remain inconsistently reported in the literature. We agree this is a key area for future research to improve treatment for this high-risk population.</p><p>Lastly, regarding the LTE's repeated call for higher-level evidence: while Level I studies are critical for validation, surgical innovation typically starts with lower levels of evidence and matures over time, an evolution supported by the IDEAL framework [<span>16</span>]. Since 2008, our group has published over 70 studies on ACL repair, contributing short- [<span>31</span>], mid-term [<span>3</span>], and soon first long-term data, while continuously refining indications and techniques [<span>4, 5, 18, 24, 26-29</span>]. We argue that research value lies not just in study level, but in methodological rigour, transparency, and clinical relevance. As van der List et al. [<span>25</span>] noted, only 32% of meta-analyses are limited to Level I–II studies. Rather than dismissing retrospective research, we advocate for its thoughtful inclusion when conducted and reported with care. Dismissing data solely by evidence level oversimplifies early-phase research's role in innovation. It should be emphasised that we cannot solely rely on Level I evidence. Members of our group are involved in designing or participating in Level I studies on this topic [<span>11, 30</span>], but these rigorous scientific studies take time and may not always reflect clinical practice [<span>1, 15, 20, 21</span>], and it is important to improve our patient selection. Our group was the first to recognise that isolated primary ACLPR in young patients has a high risk of failure rate [<span>31</span>], which was later confirmed by others, and such findings are critical to improve our outcomes [<span>8</span>]. Solely relying on randomized crontrolled trials (RCTs) will delay reporting such findings, and studies such as this meta-analysis help us to improve outcomes for our patients and redefine indications for such RCTs.</p><p>In conclusion, we value this scientific discussion and the insights shared by Rao and Yang. We hope this dialogue promotes continued improvements in the transparency and quality of meta-analyses. Crucially, we believe that the hierarchy of evidence should not be confused with a hierarchy of truth. Study design and methodology should align with the research question, and data must be critically analysed and interpreted. These principles, we believe, are the true foundation of rigorous and impactful clinical science, laying the groundwork for disruptive scientific research.</p><p>Gregory S. DiFelice receives royalties, owns stock and is a paid consultant for Zimmer Biomet, and receives royalties from Arthrex. He received stock options, provides consulting services and participates in funded research with Miach Orthopaedics. Gregory S. DiFelice received stock options and provides consulting services for OSSIO Inc. The remaining authors declare no conflicts of interest.</p>","PeriodicalId":17880,"journal":{"name":"Knee Surgery, Sports Traumatology, Arthroscopy","volume":"33 8","pages":"3057-3059"},"PeriodicalIF":5.0000,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/ksa.12735","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Knee Surgery, Sports Traumatology, Arthroscopy","FirstCategoryId":"3","ListUrlMain":"https://esskajournals.onlinelibrary.wiley.com/doi/10.1002/ksa.12735","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ORTHOPEDICS","Score":null,"Total":0}
引用次数: 0

Abstract

We would like to thank Rao and Yang for their interest in our article, ‘Anterior cruciate ligament primary repair revision rates are increased in skeletally mature patients under the age of 21 compared to reconstruction, while adults (>21 years) show no significant difference: a systematic review and meta-analysis’ [19]. We appreciate their recognition of our methodology and the clinical relevance of our findings.

While we welcome their critique, many of the points raised in their letter to the editor [32] reflect limitations we acknowledged and addressed in our manuscript. Some concerns appear to rise from incorrect interpretations or may not fully consider aspects of our analysis. In this response, we aim to clarify key points and further explain our rationale in a constructive scientific exchange.

We acknowledge the general limitations of meta-analyses, especially in a field like anterior cruciate ligament (ACL) repair where clinical adoption is evolving and high-level evidence remains limited. Accordingly, sound study design and transparent reporting are essential. Our study aimed to navigate the challenges of synthesising data from a developing field and acknowledged the predominance of retrospective designs and demographic heterogeneity. To address these limitations, we: (1) restricted inclusion to Level I–III for greater evidence homogeneity; (2) contacted all study authors for unpublished demographic and outcome data, improving data quality and enabling subgroup analyses and (3) performed an extensive risk-of-bias analysis to support a balanced discussion of current strengths and limitations. Despite these efforts, as stated in our manuscript, selection and publication bias remain possible. However, a systematic review by two independent reviewers ensured comprehensive inclusion of eligible recent studies. In response to the suggestion that ‘future meta-analyses should expand the literature search, including more high-quality prospective studies’, we would have welcomed references to specific overlooked studies to improve future analyses and the ongoing scientific dialogue.

Regarding the critique that the meta-analysis did not adequately explore heterogeneity and bias, and tools such as Egger's test [7] should have been included, we refer readers to our results section ‘Level of Evidence and Risk of Bias Assessment’, specifically figs. 6–7 and tabs. 9–10, which include funnel plots, Egger's test, and assessments using both RoB 2 [23] and MINORS tools [22]. The risk of bias analysis was even performed by two evaluators and to assess reliability of the rating the inter-rater reliability was calculated and presented as excellent for both the MINORS and Rob 2 assessments, with 0.8 and 0.9, respectively. We believe the authors have missed this in our study.

Rao and Yang also state that ‘the interpretation of certain unexpected findings lacks depth’. However, the higher revision rates in patients ≤21 years were not unexpected. This threshold was previously defined by Vermeijden et al. [31] and confirmed by Ferreira et al. [8] in matched cohort studies comparing ACL repair and reconstruction. Similarly, elevated reoperation rates due to removal of hardware have been reported for ACL repair using the dynamic intraligamentary stabilization (DIS) implant [2, 10, 12, 14], while ACL primary repair (ACLPR) and repair with the bridge enhanced ACL restoration (BEAR) scaffold have generally shown lower rates [6, 8, 9, 13, 17]. Notably, no prior review has stratified revision and reoperation rates by age and surgical technique across ACLPR, DIS, and BEAR. This stratified, technique-specific approach constitutes the novelty of our work. Furthermore, the comment of lack of depth in our analysis seems surprising as our meta-analysis has uniquely contacted the authors of the included studies, obtained full datasets when available, and performed rigorous meta-analyses beyond the standard meta-analyses published in the orthopaedic literature.

More specifically on the authors' comment regarding the higher reoperation rates following DIS, van der List et al. [25] suggest possible confounders such as selection bias and the surgeon's learning curve. While we agree these may contribute, the learning curve is a known limitation of all new surgical methods, including ACLPR and BEAR. Crucially, strong evidence links the DIS implant's design to higher reoperation risk [2, 10, 12, 14]. Moreover, the release of a second-generation, smaller implant by the manufacturer supports the view that implant-specific issues significantly contributed to these outcomes.

We also appreciate the mention of biological and behavioural factors in younger patients—such as more advanced ACL degeneration, higher postoperative activity, and metabolic differences. While important, these factors were outside our study's scope and remain inconsistently reported in the literature. We agree this is a key area for future research to improve treatment for this high-risk population.

Lastly, regarding the LTE's repeated call for higher-level evidence: while Level I studies are critical for validation, surgical innovation typically starts with lower levels of evidence and matures over time, an evolution supported by the IDEAL framework [16]. Since 2008, our group has published over 70 studies on ACL repair, contributing short- [31], mid-term [3], and soon first long-term data, while continuously refining indications and techniques [4, 5, 18, 24, 26-29]. We argue that research value lies not just in study level, but in methodological rigour, transparency, and clinical relevance. As van der List et al. [25] noted, only 32% of meta-analyses are limited to Level I–II studies. Rather than dismissing retrospective research, we advocate for its thoughtful inclusion when conducted and reported with care. Dismissing data solely by evidence level oversimplifies early-phase research's role in innovation. It should be emphasised that we cannot solely rely on Level I evidence. Members of our group are involved in designing or participating in Level I studies on this topic [11, 30], but these rigorous scientific studies take time and may not always reflect clinical practice [1, 15, 20, 21], and it is important to improve our patient selection. Our group was the first to recognise that isolated primary ACLPR in young patients has a high risk of failure rate [31], which was later confirmed by others, and such findings are critical to improve our outcomes [8]. Solely relying on randomized crontrolled trials (RCTs) will delay reporting such findings, and studies such as this meta-analysis help us to improve outcomes for our patients and redefine indications for such RCTs.

In conclusion, we value this scientific discussion and the insights shared by Rao and Yang. We hope this dialogue promotes continued improvements in the transparency and quality of meta-analyses. Crucially, we believe that the hierarchy of evidence should not be confused with a hierarchy of truth. Study design and methodology should align with the research question, and data must be critically analysed and interpreted. These principles, we believe, are the true foundation of rigorous and impactful clinical science, laying the groundwork for disruptive scientific research.

Gregory S. DiFelice receives royalties, owns stock and is a paid consultant for Zimmer Biomet, and receives royalties from Arthrex. He received stock options, provides consulting services and participates in funded research with Miach Orthopaedics. Gregory S. DiFelice received stock options and provides consulting services for OSSIO Inc. The remaining authors declare no conflicts of interest.

Abstract Image

Abstract Image

Abstract Image

回复关于年龄分层ACL修复结果的meta分析证据的致编辑信,并对证据层次之外的报告进行评论。
我们要感谢Rao和Yang对我们文章的兴趣,“21岁以下骨骼成熟患者的前交叉韧带初级修复翻修率与重建相比有所增加,而成人(21岁)没有显着差异:系统回顾和荟萃分析”[19]。我们感谢他们对我们的研究方法和临床相关性的认可。虽然我们欢迎他们的批评,但他们在给编辑[32]的信中提出的许多观点反映了我们在手稿中承认和解决的局限性。有些担忧似乎是由不正确的解释引起的,或者可能没有充分考虑我们分析的各个方面。在这篇回复中,我们的目标是澄清要点,并进一步解释我们在建设性科学交流中的基本原理。我们承认meta分析的一般局限性,特别是在像前交叉韧带(ACL)修复这样的领域,临床应用正在发展,高水平的证据仍然有限。因此,健全的研究设计和透明的报告是必不可少的。我们的研究旨在应对来自发展中领域的综合数据的挑战,并承认回顾性设计和人口异质性的优势。为了解决这些局限性,我们:(1)将纳入限制在I-III级,以获得更大的证据同质性;(2)联系所有研究作者获取未发表的人口统计和结果数据,提高数据质量并进行亚组分析;(3)进行广泛的偏倚风险分析,以支持对当前优势和局限性的平衡讨论。尽管做出了这些努力,如我们的手稿所述,选择和发表偏倚仍然可能存在。然而,由两名独立审稿人进行的系统评价确保了全面纳入符合条件的近期研究。对于“未来的荟萃分析应该扩大文献检索,包括更多高质量的前瞻性研究”的建议,我们欢迎参考一些被忽视的研究,以改进未来的分析和正在进行的科学对话。关于元分析没有充分探讨异质性和偏倚的批评,以及应该包括Egger测试[7]等工具,我们建议读者参阅我们的结果部分“证据水平和偏倚风险评估”,具体见图。6-7和标签。9-10,包括漏斗图,艾格检验,以及使用RoB 2[23]和未成年人工具[22]进行评估。偏倚风险分析甚至由两位评估者进行,为了评估评级的可靠性,计算了评估者间的信度,并为minor和Rob 2评估提供了优秀的信度,分别为0.8和0.9。我们认为作者在我们的研究中遗漏了这一点。饶和杨还指出,“对某些意外发现的解释缺乏深度”。然而,在≤21岁的患者中,更高的翻修率并不意外。该阈值先前由Vermeijden等人定义,并由Ferreira等人在比较ACL修复和重建的匹配队列研究中证实。同样,使用动态韧带内稳定(DIS)植入物修复ACL时,由于移除硬体而导致的再手术率升高[2,10,12,14],而ACL初级修复(ACLPR)和桥式增强ACL修复(BEAR)支架修复的再手术率通常较低[6,8,9,13,17]。值得注意的是,没有先前的综述对ACLPR、DIS和BEAR的翻修和再手术率按年龄和手术技术进行分层。这种分层的、特定于技术的方法构成了我们工作的新颖性。此外,我们的分析缺乏深度的评论似乎令人惊讶,因为我们的荟萃分析独特地联系了纳入研究的作者,在可用的情况下获得了完整的数据集,并进行了严格的荟萃分析,超出了骨科文献中发表的标准荟萃分析。更具体地说,对于作者关于DIS后更高的再手术率的评论,van der List等人提出了可能的混杂因素,如选择偏差和外科医生的学习曲线。虽然我们同意这些可能有所贡献,但学习曲线是所有新手术方法的已知限制,包括ACLPR和BEAR。至关重要的是,强有力的证据表明DIS植入物的设计与更高的再手术风险有关[2,10,12,14]。此外,制造商发布的第二代更小的种植体支持了种植体特异性问题对这些结果有重要影响的观点。我们也赞赏年轻患者的生物学和行为因素,如更晚期的前交叉韧带变性、更高的术后活动和代谢差异。虽然这些因素很重要,但它们超出了我们的研究范围,在文献报道中仍不一致。 我们同意这是未来研究的一个关键领域,以改善对这一高危人群的治疗。最后,关于LTE对更高水平证据的反复呼吁:虽然一级研究对验证至关重要,但手术创新通常从较低水平的证据开始,并随着时间的推移而成熟,这一演变得到了IDEAL框架[16]的支持。自2008年以来,我们小组发表了70多篇ACL修复研究,提供了短期、中期和近期的首次长期数据,同时不断完善适应证和技术[4,5,18,24,26 -29]。我们认为,研究的价值不仅在于研究水平,还在于方法的严谨性、透明度和临床相关性。正如van der List等人所指出的,只有32%的荟萃分析仅限于I-II级研究。我们不反对回顾性研究,而是提倡在进行和报告时考虑周到。仅仅通过证据水平来忽视数据,过分简化了早期研究在创新中的作用。应该强调的是,我们不能仅仅依靠一级证据。我们小组的成员参与设计或参与关于该主题的一级研究[11,30],但这些严格的科学研究需要时间,并且可能并不总是反映临床实践[1,15,20,21],改进我们的患者选择非常重要。我们的研究小组首先认识到,孤立的原发性ACLPR在年轻患者中具有很高的失败率风险,这一发现后来得到了其他人的证实,这些发现对改善我们的结果至关重要。仅仅依赖随机对照试验(rct)会延迟这些发现的报告,而像本荟萃分析这样的研究有助于我们改善患者的结果,并重新定义这些随机对照试验的适应症。总之,我们重视这一科学讨论以及饶和杨分享的见解。我们希望这次对话能够促进meta分析的透明度和质量的持续提高。至关重要的是,我们认为证据的层次不应该与真理的层次相混淆。研究设计和方法应该与研究问题保持一致,数据必须经过批判性的分析和解释。我们相信,这些原则是严谨而有影响力的临床科学的真正基础,为颠覆性的科学研究奠定了基础。Gregory S. DiFelice收取版税,拥有股票,是Zimmer Biomet的有偿顾问,并从Arthrex收取版税。他获得了股票期权,提供咨询服务,并参与了micach骨科的资助研究。Gregory S. DiFelice获得股票期权,并为OSSIO Inc.提供咨询服务。其余作者声明无利益冲突。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
8.10
自引率
18.40%
发文量
418
审稿时长
2 months
期刊介绍: Few other areas of orthopedic surgery and traumatology have undergone such a dramatic evolution in the last 10 years as knee surgery, arthroscopy and sports traumatology. Ranked among the top 33% of journals in both Orthopedics and Sports Sciences, the goal of this European journal is to publish papers about innovative knee surgery, sports trauma surgery and arthroscopy. Each issue features a series of peer-reviewed articles that deal with diagnosis and management and with basic research. Each issue also contains at least one review article about an important clinical problem. Case presentations or short notes about technical innovations are also accepted for publication. The articles cover all aspects of knee surgery and all types of sports trauma; in addition, epidemiology, diagnosis, treatment and prevention, and all types of arthroscopy (not only the knee but also the shoulder, elbow, wrist, hip, ankle, etc.) are addressed. Articles on new diagnostic techniques such as MRI and ultrasound and high-quality articles about the biomechanics of joints, muscles and tendons are included. Although this is largely a clinical journal, it is also open to basic research with clinical relevance. Because the journal is supported by a distinguished European Editorial Board, assisted by an international Advisory Board, you can be assured that the journal maintains the highest standards. Official Clinical Journal of the European Society of Sports Traumatology, Knee Surgery and Arthroscopy (ESSKA).
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信