Yijun Liu , Akram Akbar , Ting Yu , Yunlong Yu , Yuanhang Kong , Jingwen Gao , Honghao Wang , Yanyi Li , Hongduo Zhao , Chun Liu
{"title":"ARTEMIS:用于无人机快速响应的实时高效正交映射和主题识别系统","authors":"Yijun Liu , Akram Akbar , Ting Yu , Yunlong Yu , Yuanhang Kong , Jingwen Gao , Honghao Wang , Yanyi Li , Hongduo Zhao , Chun Liu","doi":"10.1016/j.isprsjprs.2025.08.026","DOIUrl":null,"url":null,"abstract":"<div><div>Rapid response to natural and human-made disasters requires both real-time mapping and identification of key targets-of-interest (TOIs)—capabilities missing in conventional Structure-from-Motion (SfM)-based unmanned aerial vehicle (UAV) mapping frameworks. While Simultaneous Localization and Mapping (SLAM)-based mapping systems offer real-time capability, they heavily depend on GPUs and reliable GNSS to process the challenging UAV imagery with high-resolution (<span><math><mo>></mo></math></span> <!--> <!-->10 megapixels) and low-overlap (60%–90%). However, these prerequisites are often unavailable in resource-constrained post-disaster deployments. To address these limitations, we introduce ARTEMIS, a CPU-centric, real-time ortho-mapping system with direct map interpretation capability. Key innovations include: (1) A projection-error-guided window search strategy, derived from generalized stereo geometry, that enables robust and efficient feature matching using lightweight descriptors (e.g., ORB) on challenging aerial data. (2) A novel, lightweight matching confidence metric that enables adaptive weighting within Bundle Adjustment (BA), prioritizing high-quality matches to enhance accuracy without tight GNSS reliance. (3) An end-to-end workflow that outputs thematic analysis automatically, using integrated state-of-the-art deep learning models (supervised and zero-shot) to identify key TOIs within the resulting Digital Orthophoto Maps (DOMs). To the best of our knowledge, this is the first study to develop and validate such an end-to-end system on real-world disaster datasets collected by first responders, covering <em>geophysical</em> (e.g., earthquakes), <em>hydrological</em> (e.g., debris flows), <em>climatological</em> (e.g., wildfires), and <em>meteorological</em> (e.g., hurricanes) events. Extensive experiments show that ARTEMIS performs up to 58× faster than SfM methods (e.g., COLMAP) in sparse reconstruction and 22× faster than commercial solutions (e.g., ContextCapture) in DOM generation, while maintaining <span><math><mo><</mo></math></span> <!--> <!-->0.5 m absolute positioning error. In mission-critical tasks like damage assessment, its thematic analysis achieves results (e.g., F1-scores and mIoU) directly comparable to those from offline, post-processed baselines. By bridging the gap between raw data collection and trustworthy intelligence, ARTEMIS demonstrates significant potential to empower immediate, informed decision-making in UAV-assisted emergency response.</div></div>","PeriodicalId":50269,"journal":{"name":"ISPRS Journal of Photogrammetry and Remote Sensing","volume":"229 ","pages":"Pages 396-421"},"PeriodicalIF":12.2000,"publicationDate":"2025-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"ARTEMIS: A real-time efficient ortho-mapping and thematic identification system for UAV-based rapid response\",\"authors\":\"Yijun Liu , Akram Akbar , Ting Yu , Yunlong Yu , Yuanhang Kong , Jingwen Gao , Honghao Wang , Yanyi Li , Hongduo Zhao , Chun Liu\",\"doi\":\"10.1016/j.isprsjprs.2025.08.026\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Rapid response to natural and human-made disasters requires both real-time mapping and identification of key targets-of-interest (TOIs)—capabilities missing in conventional Structure-from-Motion (SfM)-based unmanned aerial vehicle (UAV) mapping frameworks. While Simultaneous Localization and Mapping (SLAM)-based mapping systems offer real-time capability, they heavily depend on GPUs and reliable GNSS to process the challenging UAV imagery with high-resolution (<span><math><mo>></mo></math></span> <!--> <!-->10 megapixels) and low-overlap (60%–90%). However, these prerequisites are often unavailable in resource-constrained post-disaster deployments. To address these limitations, we introduce ARTEMIS, a CPU-centric, real-time ortho-mapping system with direct map interpretation capability. Key innovations include: (1) A projection-error-guided window search strategy, derived from generalized stereo geometry, that enables robust and efficient feature matching using lightweight descriptors (e.g., ORB) on challenging aerial data. (2) A novel, lightweight matching confidence metric that enables adaptive weighting within Bundle Adjustment (BA), prioritizing high-quality matches to enhance accuracy without tight GNSS reliance. (3) An end-to-end workflow that outputs thematic analysis automatically, using integrated state-of-the-art deep learning models (supervised and zero-shot) to identify key TOIs within the resulting Digital Orthophoto Maps (DOMs). To the best of our knowledge, this is the first study to develop and validate such an end-to-end system on real-world disaster datasets collected by first responders, covering <em>geophysical</em> (e.g., earthquakes), <em>hydrological</em> (e.g., debris flows), <em>climatological</em> (e.g., wildfires), and <em>meteorological</em> (e.g., hurricanes) events. Extensive experiments show that ARTEMIS performs up to 58× faster than SfM methods (e.g., COLMAP) in sparse reconstruction and 22× faster than commercial solutions (e.g., ContextCapture) in DOM generation, while maintaining <span><math><mo><</mo></math></span> <!--> <!-->0.5 m absolute positioning error. In mission-critical tasks like damage assessment, its thematic analysis achieves results (e.g., F1-scores and mIoU) directly comparable to those from offline, post-processed baselines. By bridging the gap between raw data collection and trustworthy intelligence, ARTEMIS demonstrates significant potential to empower immediate, informed decision-making in UAV-assisted emergency response.</div></div>\",\"PeriodicalId\":50269,\"journal\":{\"name\":\"ISPRS Journal of Photogrammetry and Remote Sensing\",\"volume\":\"229 \",\"pages\":\"Pages 396-421\"},\"PeriodicalIF\":12.2000,\"publicationDate\":\"2025-09-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ISPRS Journal of Photogrammetry and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0924271625003375\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"GEOGRAPHY, PHYSICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ISPRS Journal of Photogrammetry and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0924271625003375","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GEOGRAPHY, PHYSICAL","Score":null,"Total":0}
ARTEMIS: A real-time efficient ortho-mapping and thematic identification system for UAV-based rapid response
Rapid response to natural and human-made disasters requires both real-time mapping and identification of key targets-of-interest (TOIs)—capabilities missing in conventional Structure-from-Motion (SfM)-based unmanned aerial vehicle (UAV) mapping frameworks. While Simultaneous Localization and Mapping (SLAM)-based mapping systems offer real-time capability, they heavily depend on GPUs and reliable GNSS to process the challenging UAV imagery with high-resolution ( 10 megapixels) and low-overlap (60%–90%). However, these prerequisites are often unavailable in resource-constrained post-disaster deployments. To address these limitations, we introduce ARTEMIS, a CPU-centric, real-time ortho-mapping system with direct map interpretation capability. Key innovations include: (1) A projection-error-guided window search strategy, derived from generalized stereo geometry, that enables robust and efficient feature matching using lightweight descriptors (e.g., ORB) on challenging aerial data. (2) A novel, lightweight matching confidence metric that enables adaptive weighting within Bundle Adjustment (BA), prioritizing high-quality matches to enhance accuracy without tight GNSS reliance. (3) An end-to-end workflow that outputs thematic analysis automatically, using integrated state-of-the-art deep learning models (supervised and zero-shot) to identify key TOIs within the resulting Digital Orthophoto Maps (DOMs). To the best of our knowledge, this is the first study to develop and validate such an end-to-end system on real-world disaster datasets collected by first responders, covering geophysical (e.g., earthquakes), hydrological (e.g., debris flows), climatological (e.g., wildfires), and meteorological (e.g., hurricanes) events. Extensive experiments show that ARTEMIS performs up to 58× faster than SfM methods (e.g., COLMAP) in sparse reconstruction and 22× faster than commercial solutions (e.g., ContextCapture) in DOM generation, while maintaining 0.5 m absolute positioning error. In mission-critical tasks like damage assessment, its thematic analysis achieves results (e.g., F1-scores and mIoU) directly comparable to those from offline, post-processed baselines. By bridging the gap between raw data collection and trustworthy intelligence, ARTEMIS demonstrates significant potential to empower immediate, informed decision-making in UAV-assisted emergency response.
期刊介绍:
The ISPRS Journal of Photogrammetry and Remote Sensing (P&RS) serves as the official journal of the International Society for Photogrammetry and Remote Sensing (ISPRS). It acts as a platform for scientists and professionals worldwide who are involved in various disciplines that utilize photogrammetry, remote sensing, spatial information systems, computer vision, and related fields. The journal aims to facilitate communication and dissemination of advancements in these disciplines, while also acting as a comprehensive source of reference and archive.
P&RS endeavors to publish high-quality, peer-reviewed research papers that are preferably original and have not been published before. These papers can cover scientific/research, technological development, or application/practical aspects. Additionally, the journal welcomes papers that are based on presentations from ISPRS meetings, as long as they are considered significant contributions to the aforementioned fields.
In particular, P&RS encourages the submission of papers that are of broad scientific interest, showcase innovative applications (especially in emerging fields), have an interdisciplinary focus, discuss topics that have received limited attention in P&RS or related journals, or explore new directions in scientific or professional realms. It is preferred that theoretical papers include practical applications, while papers focusing on systems and applications should include a theoretical background.