The Wildlife Society publications' commitment to reducing bias and increasing accountability in the peer-review process

IF 1.9 3区 环境科学与生态学 Q3 ECOLOGY
Jacqueline L. Frair, Bret Collier, Steeve D. Côté, Allison Cox, Anna Knipps
{"title":"The Wildlife Society publications' commitment to reducing bias and increasing accountability in the peer-review process","authors":"Jacqueline L. Frair,&nbsp;Bret Collier,&nbsp;Steeve D. Côté,&nbsp;Allison Cox,&nbsp;Anna Knipps","doi":"10.1002/jwmg.70044","DOIUrl":null,"url":null,"abstract":"<p>We held an Associate Editor Community Forum (14 Mar 2025; 23 participants) to hear from Michael Willis, an expert on review models, about the evidence for and against DA reviews. Our AEs then suggested a range of actions TWS journals might take to overcome established biases in the peer review process, increase transparency and integrity, and help ensure that our publications remain a leading resource for wildlife conservation and management. Generally, we received engaged and insightful feedback, detected ambivalence towards wholesale changes in our peer review process, and made note of several recommendations for incremental changes that might achieve meaningful impact with relatively little time costs to our authors, reviewers, editors, and staff. To help gauge support for the various alternatives raised, including DA review, fully open review, and incremental actions, we conducted a poll of our AEs, Editors, and editorial staff (<i>n</i> = 34 responses; ~46% response rate). We report on those survey results here.</p><p>When asked if TWS journals should move to DA review, the results were equivocal, with 38% of respondents remaining on the fence (neither agreeing nor disagreeing), 32% being in favor (somewhat or strongly agreeing), and 30% being against (somewhat or strongly disagreeing). We observed moderate support for a suggested incremental alternative—specifically for keeping author names and affiliations anonymous when sending invitations to potential reviewers (to potentially minimize positive association bias when choosing to review) but revealing author names after requests are accepted (to ensure no conflicts of interest)—with 62% in favor, 24% on the fence, and 15% against. In contrast, there was a clear desire not to move to a fully open review model (73% against, 9% in favor).</p><p>With respect to other proposed incremental changes, we observed support for Editors redacting or editing clearly biased reviews (91% in favor) and requiring the Editorial Board to complete training on how to recognize and guard against implicit bias (70% in favor, 15% against). Support was also observed for continuing to diversify our board of AEs (80% in favor). The balance tipped towards encouraging (not requiring) reviewers to complete training on recognizing and guarding against implicit bias (53% in favor, 33% against, 15% on the fence)—with dissenters emphasizing the risk of disenfranchising an already overburdened pool of reviewers (a nontrivial consideration).</p><p>Two other proposed changes also received more support than not. The first involved requiring a statement of author contributions as a means of ensuring fair credit (i.e., providing more information for promotion considerations than simple authorship order)—with 66% being in favor, 26% on the fence, and 9% against. The second involved encouraging (not requiring) reviewers to sign their names to reviews to increase accountability while giving the option to not sign reviews that cause them professional concern—with 53% of respondents being in favor, 29% on the fence, and 18% against.</p><p>Lastly, we asked 2 questions about the desire to better align our journals with FAIR principles for the stewardship of scientific data (Wilkinson et al. <span>2016</span>). First, the idea of requiring (to the extent possible) the sharing of data and code received broad support (83% in favor, 6% opposed). Of course, we would need to exercise “creative flexibility” (in the words of one respondent) to keep sensitive data private to protect vulnerable species or private landowner interests, to effectively manage long-term data, for legal concerns, or for other reasons. While one respondent indicated that code should be required during the review process, when this was discussed in our Community Forum, an AE expressed concern over the burden of asking reviewers to also review code (but we note that making code available to reviewers is different from requiring that code be reviewed). Lastly, we asked whether they supported greater specificity in our currently required Data Availability statement. Although we currently have a policy of Expects Data Sharing, most authors state only “data available on request.” During our Community Forum, several AEs considered that answer to be insufficient without some explanation of why data are being held privately. The question of whether to require more details on why data are not shared at the time of publication received a strong degree of support, with 77% of respondents in favor, 14% on the fence, and 9% against.</p><p>Armed with these results, we have decided to take a semi-experimental assessment of DA review by requiring DA review for the <i>Wildlife Society Bulletin</i> while maintaining our single-anonymous review model for <i>The Journal of Wildlife Management</i> and <i>Wildlife Monographs</i>. We will conduct this test for a period of 3 years, comparing before and after data within the <i>Bulletin</i> and <i>Journal</i>. Data points will include duration of different phases of the review process and number of rounds of peer review per article, the proportion of reviewers who decline offers to review, desk rejection rates and relative acceptance rates following peer review, and the fate of submitted manuscripts. We will analyze those data with respect to the country and gender of the first author. During this time, we may briefly survey authors submitting manuscripts to the <i>Bulletin</i> on the degree to which the DA model influenced their decision to submit and the degree to which they found the process burdensome.</p><p>As of April 2025, the <i>Wildlife Society Bulletin</i> transitioned to a DA review process in concert with the roll-out of Wiley's new manuscript processing service (Research Exchange). This decision was made at this time in part because it is easier to roll back to a single-anonymous review than to transition to DA review after moving to Research Exchange. Over the next 3 years, we will be tracking data on the costs and benefits of this decision.</p><p>Although we do not collect demographic information on authors that could be tied to review bias (e.g., gender identity, stage in career, languages spoken, socioeconomic background), we will investigate methods of assessing if our actions affect meaningful improvements in the equal treatment of manuscripts given the data available (e.g., manuscript success by geographic region or inferred gender of author name). Several of these actions are already being acted upon and those that require updated guidelines and revised communications for authors and reviewers will be rolled out in concert with the shift of our journals to Research Exchange for review, scheduled for late summer or fall 2025. As always, we value your feedback on these actions and other recommendations to help sustain the status of TWS publications as leaders in the field of wildlife conservation and management.</p>","PeriodicalId":17504,"journal":{"name":"Journal of Wildlife Management","volume":"89 5","pages":""},"PeriodicalIF":1.9000,"publicationDate":"2025-05-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/jwmg.70044","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Wildlife Management","FirstCategoryId":"93","ListUrlMain":"https://wildlife.onlinelibrary.wiley.com/doi/10.1002/jwmg.70044","RegionNum":3,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ECOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

We held an Associate Editor Community Forum (14 Mar 2025; 23 participants) to hear from Michael Willis, an expert on review models, about the evidence for and against DA reviews. Our AEs then suggested a range of actions TWS journals might take to overcome established biases in the peer review process, increase transparency and integrity, and help ensure that our publications remain a leading resource for wildlife conservation and management. Generally, we received engaged and insightful feedback, detected ambivalence towards wholesale changes in our peer review process, and made note of several recommendations for incremental changes that might achieve meaningful impact with relatively little time costs to our authors, reviewers, editors, and staff. To help gauge support for the various alternatives raised, including DA review, fully open review, and incremental actions, we conducted a poll of our AEs, Editors, and editorial staff (n = 34 responses; ~46% response rate). We report on those survey results here.

When asked if TWS journals should move to DA review, the results were equivocal, with 38% of respondents remaining on the fence (neither agreeing nor disagreeing), 32% being in favor (somewhat or strongly agreeing), and 30% being against (somewhat or strongly disagreeing). We observed moderate support for a suggested incremental alternative—specifically for keeping author names and affiliations anonymous when sending invitations to potential reviewers (to potentially minimize positive association bias when choosing to review) but revealing author names after requests are accepted (to ensure no conflicts of interest)—with 62% in favor, 24% on the fence, and 15% against. In contrast, there was a clear desire not to move to a fully open review model (73% against, 9% in favor).

With respect to other proposed incremental changes, we observed support for Editors redacting or editing clearly biased reviews (91% in favor) and requiring the Editorial Board to complete training on how to recognize and guard against implicit bias (70% in favor, 15% against). Support was also observed for continuing to diversify our board of AEs (80% in favor). The balance tipped towards encouraging (not requiring) reviewers to complete training on recognizing and guarding against implicit bias (53% in favor, 33% against, 15% on the fence)—with dissenters emphasizing the risk of disenfranchising an already overburdened pool of reviewers (a nontrivial consideration).

Two other proposed changes also received more support than not. The first involved requiring a statement of author contributions as a means of ensuring fair credit (i.e., providing more information for promotion considerations than simple authorship order)—with 66% being in favor, 26% on the fence, and 9% against. The second involved encouraging (not requiring) reviewers to sign their names to reviews to increase accountability while giving the option to not sign reviews that cause them professional concern—with 53% of respondents being in favor, 29% on the fence, and 18% against.

Lastly, we asked 2 questions about the desire to better align our journals with FAIR principles for the stewardship of scientific data (Wilkinson et al. 2016). First, the idea of requiring (to the extent possible) the sharing of data and code received broad support (83% in favor, 6% opposed). Of course, we would need to exercise “creative flexibility” (in the words of one respondent) to keep sensitive data private to protect vulnerable species or private landowner interests, to effectively manage long-term data, for legal concerns, or for other reasons. While one respondent indicated that code should be required during the review process, when this was discussed in our Community Forum, an AE expressed concern over the burden of asking reviewers to also review code (but we note that making code available to reviewers is different from requiring that code be reviewed). Lastly, we asked whether they supported greater specificity in our currently required Data Availability statement. Although we currently have a policy of Expects Data Sharing, most authors state only “data available on request.” During our Community Forum, several AEs considered that answer to be insufficient without some explanation of why data are being held privately. The question of whether to require more details on why data are not shared at the time of publication received a strong degree of support, with 77% of respondents in favor, 14% on the fence, and 9% against.

Armed with these results, we have decided to take a semi-experimental assessment of DA review by requiring DA review for the Wildlife Society Bulletin while maintaining our single-anonymous review model for The Journal of Wildlife Management and Wildlife Monographs. We will conduct this test for a period of 3 years, comparing before and after data within the Bulletin and Journal. Data points will include duration of different phases of the review process and number of rounds of peer review per article, the proportion of reviewers who decline offers to review, desk rejection rates and relative acceptance rates following peer review, and the fate of submitted manuscripts. We will analyze those data with respect to the country and gender of the first author. During this time, we may briefly survey authors submitting manuscripts to the Bulletin on the degree to which the DA model influenced their decision to submit and the degree to which they found the process burdensome.

As of April 2025, the Wildlife Society Bulletin transitioned to a DA review process in concert with the roll-out of Wiley's new manuscript processing service (Research Exchange). This decision was made at this time in part because it is easier to roll back to a single-anonymous review than to transition to DA review after moving to Research Exchange. Over the next 3 years, we will be tracking data on the costs and benefits of this decision.

Although we do not collect demographic information on authors that could be tied to review bias (e.g., gender identity, stage in career, languages spoken, socioeconomic background), we will investigate methods of assessing if our actions affect meaningful improvements in the equal treatment of manuscripts given the data available (e.g., manuscript success by geographic region or inferred gender of author name). Several of these actions are already being acted upon and those that require updated guidelines and revised communications for authors and reviewers will be rolled out in concert with the shift of our journals to Research Exchange for review, scheduled for late summer or fall 2025. As always, we value your feedback on these actions and other recommendations to help sustain the status of TWS publications as leaders in the field of wildlife conservation and management.

Abstract Image

Abstract Image

Abstract Image

野生动物协会出版物致力于在同行评审过程中减少偏见和增加问责制
我们举办了副主编社区论坛(2025年3月14日;23名参与者)听取了评论模型专家Michael Willis关于支持和反对DA评论的证据。然后,我们的ae建议了TWS期刊可以采取的一系列措施,以克服同行评议过程中的既定偏见,提高透明度和完整性,并帮助确保我们的出版物仍然是野生动物保护和管理的主要资源。总的来说,我们收到了积极的、有见地的反馈,在同行评审过程中发现了对大规模变化的矛盾心理,并对增量变化提出了一些建议,这些建议可能会对我们的作者、审稿人、编辑和员工产生相对较少的时间成本,从而产生有意义的影响。为了帮助衡量对提出的各种备选方案的支持程度,包括DA审查、完全公开审查和增量行动,我们对我们的副主编、编辑和编辑人员进行了民意调查(n = 34份答复;~46%应答率)。我们在这里报道这些调查结果。当被问及TWS期刊是否应该转向DA评审时,结果是模棱两可的,38%的受访者保持中立(既不同意也不反对),32%的受访者赞成(有些或强烈同意),30%的受访者反对(有些或强烈不同意)。我们观察到对建议的增量替代方案的适度支持-特别是在向潜在审稿人发送邀请时保持作者姓名和所属机构匿名(以潜在地减少选择审稿人时的积极关联偏见),但在接受请求后显示作者姓名(以确保没有利益冲突)- 62%的人赞成,24%的人持中立态度,15%的人反对。相反,有一个明确的愿望,不转移到一个完全开放的审查模式(73%的人反对,9%的人赞成)。关于其他建议的增量更改,我们观察到支持编辑编辑或编辑明显有偏见的评论(91%赞成),并要求编辑委员会完成如何识别和防范隐性偏见的培训(70%赞成,15%反对)。我们也观察到支持继续多样化我们董事会的ae(80%赞成)。天平倾向于鼓励(而不是要求)审稿人完成识别和防范隐性偏见的培训(53%的人赞成,33%的人反对,15%的人持中立态度)——反对者强调剥夺已经负担过重的审稿人的权利的风险(一个重要的考虑因素)。另外两项拟议的改革也得到了更多的支持。第一个涉及要求作者的贡献声明,作为确保公平信用的一种手段(即,提供更多的信息来考虑晋升,而不是简单的作者顺序)——66%的人赞成,26%的人持中立态度,9%的人反对。第二种方法是鼓励(而不是要求)评审人员在评审中签名,以增加问责制,同时给予不签署引起他们专业关注的评审的选择——53%的受访者赞成,29%的人持中立态度,18%的人反对。最后,我们问了两个问题,关于我们希望更好地使我们的期刊与科学数据管理的公平原则保持一致的愿望(Wilkinson et al. 2016)。首先,要求(尽可能)共享数据和代码的想法得到了广泛的支持(83%的人赞成,6%的人反对)。当然,出于法律考虑或其他原因,我们需要行使“创造性灵活性”(用一位受访者的话来说),将敏感数据保密,以保护脆弱物种或私人土地所有者的利益,有效管理长期数据。当一个回答者指出在审查过程中应该需要代码时,当在我们的社区论坛中讨论这个问题时,一个AE表达了对要求审查者也审查代码的负担的关注(但是我们注意到让审查者使用代码与要求代码被审查是不同的)。最后,我们询问他们是否支持在我们目前要求的数据可用性声明中增加更多的特异性。虽然我们目前有一个期望数据共享的政策,但大多数作者只声明“根据请求提供数据”。在我们的社区论坛上,一些ae认为这个答案是不够的,没有解释为什么数据被私人持有。是否需要更多细节来说明为什么数据在发布时不被共享的问题得到了强烈的支持,77%的受访者表示赞成,14%持中立态度,9%反对。有了这些结果,我们决定采取一种半实验性的DA审查方式,要求《野生动物学会公报》进行DA审查,同时保持《野生动物管理杂志》和《野生动物专著》的单匿名审查模式。我们将进行为期3年的测试,比较Bulletin和Journal中前后的数据。 数据点将包括评审过程不同阶段的持续时间和每篇文章的同行评审轮次,拒绝评审的审稿人比例,同行评审后的办公桌拒签率和相对接受率,以及提交稿件的命运。我们将根据第一作者的国家和性别来分析这些数据。在此期间,我们可能会简要调查向《公报》提交稿件的作者,了解数据数据模型在多大程度上影响了他们的提交决定,以及他们在多大程度上觉得这个过程很繁琐。截至2025年4月,《野生动物协会公报》过渡到DA审查过程,同时推出了Wiley新的手稿处理服务(研究交流)。这个决定是在这个时候做出的,部分原因是在转移到Research Exchange后,回滚到单一匿名评审比过渡到DA评审更容易。在接下来的三年里,我们将跟踪这一决定的成本和收益数据。虽然我们没有收集可能与评审偏倚相关的作者人口统计信息(例如,性别认同、职业阶段、使用的语言、社会经济背景),但我们将研究评估我们的行动是否影响了现有数据(例如,按地理区域或作者姓名推断的性别)对手稿平等待遇的有意义改善的方法。其中一些行动已经付诸实施,那些需要更新指南和修改作者和审稿人沟通的行动将随着我们的期刊转移到Research Exchange进行审查而推出,计划于2025年夏末或秋季进行。与往常一样,我们非常重视您对这些行动和其他建议的反馈,以帮助维持TWS出版物在野生动物保护和管理领域的领导地位。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of Wildlife Management
Journal of Wildlife Management 环境科学-动物学
CiteScore
4.00
自引率
13.00%
发文量
188
审稿时长
9-24 weeks
期刊介绍: The Journal of Wildlife Management publishes manuscripts containing information from original research that contributes to basic wildlife science. Suitable topics include investigations into the biology and ecology of wildlife and their habitats that has direct or indirect implications for wildlife management and conservation. This includes basic information on wildlife habitat use, reproduction, genetics, demographics, viability, predator-prey relationships, space-use, movements, behavior, and physiology; but within the context of contemporary management and conservation issues such that the knowledge may ultimately be useful to wildlife practitioners. Also considered are theoretical and conceptual aspects of wildlife science, including development of new approaches to quantitative analyses, modeling of wildlife populations and habitats, and other topics that are germane to advancing wildlife science. Limited reviews or meta analyses will be considered if they provide a meaningful new synthesis or perspective on an appropriate subject. Direct evaluation of management practices or policies should be sent to the Wildlife Society Bulletin, as should papers reporting new tools or techniques. However, papers that report new tools or techniques, or effects of management practices, within the context of a broader study investigating basic wildlife biology and ecology will be considered by The Journal of Wildlife Management. Book reviews of relevant topics in basic wildlife research and biology.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信