C. R. Fol, A. Murtiyoso, D. Kükenbrink, F. Remondino, V. C. Griess
{"title":"TERRESTRIAL 3D MAPPING OF FORESTS: GEOREFERENCING CHALLENGES AND SENSORS COMPARISONS","authors":"C. R. Fol, A. Murtiyoso, D. Kükenbrink, F. Remondino, V. C. Griess","doi":"10.5194/isprs-archives-xlviii-1-w3-2023-55-2023","DOIUrl":"https://doi.org/10.5194/isprs-archives-xlviii-1-w3-2023-55-2023","url":null,"abstract":"Abstract. Terrestrial 3D reconstruction is a research topic that has recently received significant attention in the forestry sector. This practice enables the acquisition of high-quality 3D data, which can be used not only to derive physical forest criteria such as tree positions and diameters, but also more detailed analyses related to ecological parameters such as habitat availability and biomass. However, several challenges must be addressed before fully integrating this technology into forestry practices. The primary challenge is accurately georeferencing surveyed 3D data acquired in the same location and placing them into a national projection reference system. Unfortunately, due to the forest canopy, the GNSS signal is often obstructed, and it cannot guarantee sub-meter accuracy. In this paper, we have implemented an indirect georeferencing methodology based on spheres with known coordinates placed at the forest’s edge where GNSS reception was more reliable and accurate than under the canopy. We evaluated its performance through three analyses that confirmed the validity of our approach. Indeed, the accuracy of the TLS point cloud, georeferenced using our method, is within a centimetre level (4.7 cm), whereas mobile scanning methods demonstrate accuracy within the decimetre range but still less than a metre. Additionally, we have initiated the analysis of a potential future application for mixed reality headsets, which could enable real-time acquisition and visualisation of 3D data.","PeriodicalId":30634,"journal":{"name":"The International Archives of the Photogrammetry Remote Sensing and Spatial Information Sciences","volume":"36 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135728614","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A NEW DATASET AND METHODOLOGY FOR URBAN-SCALE 3D POINT CLOUD CLASSIFICATION","authors":"O. C. Bayrak, F. Remondino, M. Uzar","doi":"10.5194/isprs-archives-xlviii-1-w3-2023-1-2023","DOIUrl":"https://doi.org/10.5194/isprs-archives-xlviii-1-w3-2023-1-2023","url":null,"abstract":"Abstract. Urban landscapes are characterized by a multitude of diverse objects, each bearing unique significance in urban management and development. With the rapid evolution and deployment of Unmanned Aerial Vehicle (UAV) technologies, the 3D surveying of urban areas through high resolution point clouds and orthoimages has become more feasible. This technological leap enhances our capacity to comprehensively capture and analyze urban spaces. This contribution introduces a new urban dataset, called YTU3D, which covers an area of approximately 2 km2 and encompasses 45 distinct classes. Notably, YTU3D exceeds the class diversity of existing datasets, thereby enhancing its suitability for detailed urban analysis tasks. The paper presents also the application of three popular deep learning methods in the context of 3D semantic segmentation, along with a multi-level multi-resolution (MLMR) integration. Significantly, our work marks the first application of deep learning with MLMR in the literature and shows that a MLMR approach can improve the classification accuracy. The YTU3D dataset and research findings are publicly available at https://github.com/3DOM-FBK/YTU3D.","PeriodicalId":30634,"journal":{"name":"The International Archives of the Photogrammetry Remote Sensing and Spatial Information Sciences","volume":"55 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135728901","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"UNET NEURAL NETWORK IN AGRICULTURAL LAND COVER CLASSIFICATION USING SENTINEL-2","authors":"P. Kramarczyk, B. Hejmanowska","doi":"10.5194/isprs-archives-xlviii-1-w3-2023-85-2023","DOIUrl":"https://doi.org/10.5194/isprs-archives-xlviii-1-w3-2023-85-2023","url":null,"abstract":"Abstract. The article discusses a method for classifying land cover types in rural areas using a trained neural network. The focus is on distinguishing agriculturally cultivated areas and differentiating bare soil from quarry areas. This distinction is not present in publicly available databases like CORINE, UrbanAtlas, EuroSAT, or BigEarthNet. The research involves training a neural network on multi-temporal patches to classify Sentinel-2 images rapidly. This approach allows automated monitoring of cultivated areas, determining periods of bare soil vulnerability to erosion, and identifying open-pit areas with similar spectral characteristics to bare soil. After training the U-Net network, it achieved an average classification accuracy of 90% (OA) in the test areas, highlighting the importance of using OA for multi-class classifications, instead of ACC. Analysis of our main classes revealed high accuracy, 99.01% for quarries, 92.3% for bare soil, and an average of 94.8% for annual crops, demonstrating the model's capability to differentiate between crops at various growth stages and assess land cover categories effectively.","PeriodicalId":30634,"journal":{"name":"The International Archives of the Photogrammetry Remote Sensing and Spatial Information Sciences","volume":"194 3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135729197","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"SELECTED QUALITATIVE ASPECTS OF LIDAR POINT CLOUDS: GEOSLAM ZEB-REVO AND FARO FOCUS 3D X130","authors":"A. Warchoł, T. Karaś, M. Antoń","doi":"10.5194/isprs-archives-xlviii-1-w3-2023-205-2023","DOIUrl":"https://doi.org/10.5194/isprs-archives-xlviii-1-w3-2023-205-2023","url":null,"abstract":"Abstract. This paper presents a comparison of LiDAR point clouds acquired using two, different measurement techniques: static TLS (Terrestrial Laser Scanning) performed with a FARO Focus3D X130 laser scanner and a SLAM-based (Simultaneous Localization and Mapping) unit of MLS (Mobile Laser Scanning), namely GeoSLAM ZEB-REVO. After the two point clouds were brought into a single coordinate system, they were compared with each other in terms of internal accuracy and density. The density aspect was visualized using 2D density rasters, and calculated using 3 methods available in CloudCompare software. Thus, one should consider before choosing how to acquire a LiDAR point cloud whether a short measurement time is more important (ZEB-REVO) or whether higher density and measurement accuracy is more important (FARO Focus3D X130). In BIM/HBIM modeling applications, logic dictates that the TLS solution should be chosen, despite the longer data acquisition and processing time, but with a cloud with far better quality parameters that allow objects on the point cloud to be recognized. In a situation where the TLS point cloud is 20 times more dense, it allows to model objects at the appropriate level of geometric detail.","PeriodicalId":30634,"journal":{"name":"The International Archives of the Photogrammetry Remote Sensing and Spatial Information Sciences","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135729260","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Y. Yadav, S. K. P. Kushwaha, M. Mokros, J. Chudá, M. Pondelík
{"title":"INTEGRATION OF IPHONE LiDAR WITH QUADCOPTER AND FIXED WING UAV PHOTOGRAMMETRY FOR THE FORESTRY APPLICATIONS","authors":"Y. Yadav, S. K. P. Kushwaha, M. Mokros, J. Chudá, M. Pondelík","doi":"10.5194/isprs-archives-xlviii-1-w3-2023-213-2023","DOIUrl":"https://doi.org/10.5194/isprs-archives-xlviii-1-w3-2023-213-2023","url":null,"abstract":"Abstract. The recent innovations in remote sensing technologies have given rise to the efficient mapping and monitoring of forests. The developments in the sensor implementation have mainly focused on optimizing the payload of the UAV system and allowed the users to acquire the data simultaneously with a range of active and passive sensors like high-resolution RGB cameras and multispectral cameras LiDAR (Laser Imaging Detection and Ranging). The main objective of this research contribution is to combine the Digital Elevation Model (DEMs) from quadcopter Unmanned Aerial Vehicles (UAVs), Fixed Wing UAV-based cameras, and iPhone datasets for the forest plots. The datasets from two vegetation seasons, namely leaf-off and leaf-on, were used to combine the Digital Elevation Models from different data acquisition platforms. This internship research work aims to create and experiment with new methods, techniques, and technologies for the applications of UAV photogrammetry and iPhone LiDAR in forest napping and inventory management. CHMs are also generated in this work which helps assess the conditions of the forests in the recreational areas, and the possibility of solutions like iPhone LiDAR and UAV photogrammetry would be highly efficient and economical. The leaf-off and leaf-on datasets were processed in Agisoft Metashape Professional software to generate dense point clouds for the forest plots. The point cloud from the leaf-on dataset was rasterized to generate a DSM whereas the leaf-off point cloud generated a DSM of the forest plots after ground filtering with Cloth Simulation Filter (CSF) plugin. The iPhone LiDAR point was also rasterized to a DTM product after pre-processing steps and noise removal. The Canopy Height Models (CHMs) were generated by subtracting UAV and iPhone LiDAR based DTMs from the UAV leaf on DSM. Finally, the accuracy assessment of CHMs from UAB datasets and their integration with iPhone LiDAR has been assessed using the accurate tree heights measured during the forest field visits. The proposed methodology can be used for forest mapping purposes where a moderate accuracy is requested.","PeriodicalId":30634,"journal":{"name":"The International Archives of the Photogrammetry Remote Sensing and Spatial Information Sciences","volume":"161 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135729592","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"EVALUATION OF CONSUMER-GRADE AND SURVEY-GRADE UAV-LIDAR","authors":"G. Mandlburger, M. Kölle, F. Pöppl, M. Cramer","doi":"10.5194/isprs-archives-xlviii-1-w3-2023-99-2023","DOIUrl":"https://doi.org/10.5194/isprs-archives-xlviii-1-w3-2023-99-2023","url":null,"abstract":"Abstract. Driven by developments in the automotive industry, the availability of compact consumer-grade LiDAR (Light Detection and Ranging) sensors has increased significantly in recent years. Some of these sensors are also suitable for UAV-based surveying tasks. This paper first discusses the differences between consumer-grade and survey-grade LiDAR systems. Special attention will be paid to the scanning mechanisms used on the one hand and to different solutions for the transceiver units on the other hand. Based on the technical data of two concrete systems, the consumer-grade DJI Zenmuse L1 sensor and the survey-grade scanner RIEGL VUX-1UAV, the expected effects of the sensor parameters on the 3D point cloud are first discussed theoretically and then verified using an exemplary data set in Hessigheim (Baden-Württemberg, Germany). The analysis shows the possibilities and limitations of consumer-grade LiDAR. Compared to the low-cost sensor, the high-end scanner exhibits lower range measurement noise (5–10 mm) and better 3D point location accuracy. Furthermore, the higher laser beam quality of high-end devices (beam divergence, beam shape) enables more detailed object detection at the same point density. With moderate accuracy requirements of 5–10 cm, however, applications in the geodetic-cartographic context also arise for the considerably less expensive consumer-grade LiDAR systems.","PeriodicalId":30634,"journal":{"name":"The International Archives of the Photogrammetry Remote Sensing and Spatial Information Sciences","volume":"43 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135666805","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. Schmidt, V. Volland, P. Hübner, D. Iwaszczuk, A. Eichhorn
{"title":"EVALUATING GEOMETRY OF AN INDOOR SCENARIO WITH OCCLUSIONS BASED ON TOTAL STATION MEASUREMENTS OF WALL ELEMENTS","authors":"J. Schmidt, V. Volland, P. Hübner, D. Iwaszczuk, A. Eichhorn","doi":"10.5194/isprs-archives-xlviii-1-w3-2023-183-2023","DOIUrl":"https://doi.org/10.5194/isprs-archives-xlviii-1-w3-2023-183-2023","url":null,"abstract":"Abstract. Scan2BIM approaches, i.e. the automated reconstruction of building models from point cloud data, is typically evaluated against the same point clouds which are used as input for the reconstruction process. In doing so, the point clouds are often used as ground truth without considering their own inaccuracies. Thus, in this research, we investigate the manual creation of an accurate ground truth, with a process which takes into account the measurement accuracy as well as the modeling accuracy. Therefore we created a ground truth to an existing laser scan data with a total station, based on the assumption that a total station generally measures points more reliably. In addition, a manual selection and classification of points on the wall surfaces during the measurement, serves a reliable detection of the walls via plane fitting. This allows for the creation of a more reliable ground truth, which is determined by the intersection of the planes from corners and edges. The ground truth is aligned parallel to the axes of a local coordinate system. From MLS and TLS point clouds of the same building area, walls are manually classified and corners and edges are determined in a similar way to the total station. These TLS and MLS corners are registered to this ground truth using least squares optimisation at the vertices. The transformation thus determined is used to transform the laser scanning point clouds as well. The resulting errors in the corners and the whole point cloud are evaluated. We conclude that the standard deviation of wall surfaces alone isn’t sufficient to determine the quality of the reconstructed building model. Despite low measurement noise in single wall surfaces, deviations in the reconstructed room model may arise.","PeriodicalId":30634,"journal":{"name":"The International Archives of the Photogrammetry Remote Sensing and Spatial Information Sciences","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135728586","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
F. Nex, N. Zhang, F. Remondino, E. M. Farella, R. Qin, C. Zhang
{"title":"BENCHMARKING THE EXTRACTION OF 3D GEOMETRY FROM UAV IMAGES WITH DEEP LEARNING METHODS","authors":"F. Nex, N. Zhang, F. Remondino, E. M. Farella, R. Qin, C. Zhang","doi":"10.5194/isprs-archives-xlviii-1-w3-2023-123-2023","DOIUrl":"https://doi.org/10.5194/isprs-archives-xlviii-1-w3-2023-123-2023","url":null,"abstract":"Abstract. 3D reconstruction from single and multi-view stereo images is still an open research topic, despite the high number of solutions proposed in the last decades. The surge of deep learning methods has then stimulated the development of new methods using monocular (MDE, Monocular Depth Estimation), stereoscopic and Multi-View Stereo (MVS) 3D reconstruction, showing promising results, often comparable to or even better than traditional methods. The more recent development of NeRF (Neural Radial Fields) has further triggered the interest for this kind of solution. Most of the proposed approaches, however, focus on terrestrial applications (e.g., autonomous driving or small artefacts 3D reconstructions), while airborne and UAV acquisitions are often overlooked. The recent introduction of new datasets, such as UseGeo has, therefore, given the opportunity to assess how state-of-the-art MDE, MVS and NeRF 3D reconstruction algorithms perform using airborne UAV images, allowing their comparison with LiDAR ground truth. This paper aims to present the results achieved by two MDE, two MVS and two NeRF approaches levering deep learning approaches, trained and tested using the UseGeo dataset. This work allows the comparison with a ground truth showing the current state of the art of these solutions and providing useful indications for their future development and improvement.","PeriodicalId":30634,"journal":{"name":"The International Archives of the Photogrammetry Remote Sensing and Spatial Information Sciences","volume":"41 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135729146","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"INVESTIGATION ON THE USE OF NeRF FOR HERITAGE 3D DENSE RECONSTRUCTION FOR INTERIOR SPACES","authors":"A. Murtiyoso, J. Markiewicz, A. K. Karwel, P. Kot","doi":"10.5194/isprs-archives-xlviii-1-w3-2023-115-2023","DOIUrl":"https://doi.org/10.5194/isprs-archives-xlviii-1-w3-2023-115-2023","url":null,"abstract":"Abstract. The concept of Neural Radiance Fields (NeRF) emerged in recent years as a method to create novel synthetic 3D viewpoints from a set of trained images. While it has several overlaps with conventional photogrammetry and especially multi-view stereo (MVS), its main point of interest is the capability to rapidly recreate objects in 3D. In this paper, we investigate the quality of point clouds generated by state-of-the-art NeRF in the context of interior spaces and compare them to four conventional MVS algorithms, of which two are commercial (Agisoft Metashape and Pix4D) and the other two open source (Patch-Match and Semi-Global Matching). Three synthetic datasets of interior scenes were created from laser scanning data with different characteristics and architectural elements. Results show that NeRF point clouds could achieve satisfactory results geometrically speaking, with an average standard deviation of 1.7 cm in interior cases where the scene dimension is roughly 25–50 m3 in volume. However, the level of noise on the point cloud, which was considered as out of tolerance, ranges between 17–42%, meaning that the level of detail and finesse is most likely insufficient for sophisticated heritage documentation purposes, even though from a visualisation point of view the results were better. However, NeRF did show the capability to reconstruct texture less and reflective surfaces where MVS failed.","PeriodicalId":30634,"journal":{"name":"The International Archives of the Photogrammetry Remote Sensing and Spatial Information Sciences","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135728594","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A 3D INDOOR-OUTDOOR BENCHMARK DATASET FOR LoD3 BUILDING POINT CLOUD SEMANTIC SEGMENTATION","authors":"Y. Cao, M. Scaioni","doi":"10.5194/isprs-archives-xlviii-1-w3-2023-31-2023","DOIUrl":"https://doi.org/10.5194/isprs-archives-xlviii-1-w3-2023-31-2023","url":null,"abstract":"Abstract. Deep learning (DL) algorithms require high quality training samples as well as accurate and thorough annotations to work effectively. Up until now a limited number of datasets are available to train DL techniques for semantic segmentation of 3D building point clouds, except a few ones focusing on specific categories of constructions (e.g., cultural heritage buildings). This paper presents a new 3D Indoor/Outdoor building dataset (BIO dataset), which is aimed to provide a highly accurate, detailed, and comprehensive dataset to be used for applications related to sematic classification of buildings based on point clouds and meshes. This benchmark dataset contains 100 building models generated from existing polygonal models and belonging to different categories. These include commercial buildings, residential houses, industrial and institutional buildings. Structural elements of buildings are annotated into 11 semantic categories, following standards from IFC and CityGML. To verify the applicability of the BIO dataset for the semantic segmentation task, it has been successfully tested by using one machine learning technique and four different DL algorithms.","PeriodicalId":30634,"journal":{"name":"The International Archives of the Photogrammetry Remote Sensing and Spatial Information Sciences","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135729040","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}