知道我们不知道什么:冲突研究中数据质量的基本问题和方法论解决方案

IF 2.2 1区 社会学 Q1 INTERNATIONAL RELATIONS
Rachel Sweet
{"title":"知道我们不知道什么:冲突研究中数据质量的基本问题和方法论解决方案","authors":"Rachel Sweet","doi":"10.1177/00220027251325877","DOIUrl":null,"url":null,"abstract":"Conflict researchers face an unresolved dilemma: the underlying data are often unreliable. When it comes to covert relationships, killings, and illicit markets that organized violence entails, there are simply more incentives to alter information than to tell it straight. How confident can scholars be that on-the-ground events, rather than strategic or omitted information, drive research findings? Despite the evident need for accurate views into clandestine processes, existing work rarely applies systematic checks to verify the seeming “facts” of conflict. This article proposes a methodological toolkit to fill this gap. A first step develops systematic checks to report numerical credibility scores of source quality and corresponding error estimates. A second leverages data of varied strengths for distinct purposes: high-quality sources to triangulate facts and low-quality data to discern strategic images and mis/disinformation. The article tests these standards against major datasets and integrates the protocols into an interactive Data Evaluation Dashboard available for scholarly and policy use.","PeriodicalId":51363,"journal":{"name":"Journal of Conflict Resolution","volume":"96 1","pages":""},"PeriodicalIF":2.2000,"publicationDate":"2025-05-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Knowing What We Don’t: The Fundamental Problem of Data Quality in Conflict Research—and Methodological Solutions\",\"authors\":\"Rachel Sweet\",\"doi\":\"10.1177/00220027251325877\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Conflict researchers face an unresolved dilemma: the underlying data are often unreliable. When it comes to covert relationships, killings, and illicit markets that organized violence entails, there are simply more incentives to alter information than to tell it straight. How confident can scholars be that on-the-ground events, rather than strategic or omitted information, drive research findings? Despite the evident need for accurate views into clandestine processes, existing work rarely applies systematic checks to verify the seeming “facts” of conflict. This article proposes a methodological toolkit to fill this gap. A first step develops systematic checks to report numerical credibility scores of source quality and corresponding error estimates. A second leverages data of varied strengths for distinct purposes: high-quality sources to triangulate facts and low-quality data to discern strategic images and mis/disinformation. The article tests these standards against major datasets and integrates the protocols into an interactive Data Evaluation Dashboard available for scholarly and policy use.\",\"PeriodicalId\":51363,\"journal\":{\"name\":\"Journal of Conflict Resolution\",\"volume\":\"96 1\",\"pages\":\"\"},\"PeriodicalIF\":2.2000,\"publicationDate\":\"2025-05-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Conflict Resolution\",\"FirstCategoryId\":\"90\",\"ListUrlMain\":\"https://doi.org/10.1177/00220027251325877\",\"RegionNum\":1,\"RegionCategory\":\"社会学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"INTERNATIONAL RELATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Conflict Resolution","FirstCategoryId":"90","ListUrlMain":"https://doi.org/10.1177/00220027251325877","RegionNum":1,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"INTERNATIONAL RELATIONS","Score":null,"Total":0}
引用次数: 0

摘要

冲突研究人员面临着一个尚未解决的困境:基础数据往往不可靠。当涉及到有组织的暴力所涉及的秘密关系、杀戮和非法市场时,改变信息的动机比直接说出信息的动机更大。学者们有多大的信心相信,推动研究成果的是实际事件,而不是战略性或被遗漏的信息?尽管显然需要对秘密进程有准确的了解,但现有的工作很少采用系统的检查来核实冲突的表面“事实”。本文提出了一个方法工具包来填补这一空白。第一步是发展系统检查,以报告源质量的数字可信度分数和相应的误差估计。第二种是利用不同强度的数据来实现不同的目的:高质量的来源来三角测量事实,低质量的数据来辨别战略图像和错误/虚假信息。本文针对主要数据集测试了这些标准,并将这些协议集成到一个交互式数据评估仪表板中,供学术和政策使用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Knowing What We Don’t: The Fundamental Problem of Data Quality in Conflict Research—and Methodological Solutions
Conflict researchers face an unresolved dilemma: the underlying data are often unreliable. When it comes to covert relationships, killings, and illicit markets that organized violence entails, there are simply more incentives to alter information than to tell it straight. How confident can scholars be that on-the-ground events, rather than strategic or omitted information, drive research findings? Despite the evident need for accurate views into clandestine processes, existing work rarely applies systematic checks to verify the seeming “facts” of conflict. This article proposes a methodological toolkit to fill this gap. A first step develops systematic checks to report numerical credibility scores of source quality and corresponding error estimates. A second leverages data of varied strengths for distinct purposes: high-quality sources to triangulate facts and low-quality data to discern strategic images and mis/disinformation. The article tests these standards against major datasets and integrates the protocols into an interactive Data Evaluation Dashboard available for scholarly and policy use.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
5.30
自引率
9.70%
发文量
101
期刊介绍: The Journal of Conflict Resolution is an interdisciplinary journal of social scientific theory and research on human conflict. It focuses especially on international conflict, but its pages are open to a variety of contributions about intergroup conflict, as well as between nations, that may help in understanding problems of war and peace. Reports about innovative applications, as well as basic research, are welcomed, especially when the results are of interest to scholars in several disciplines.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信