Steven Stalder , Michele Volpi , Nicolas Büttner , Stephen Law , Kenneth Harttgen , Esra Suel
{"title":"自我监督学习从街道图像中揭示城市变化","authors":"Steven Stalder , Michele Volpi , Nicolas Büttner , Stephen Law , Kenneth Harttgen , Esra Suel","doi":"10.1016/j.compenvurbsys.2024.102156","DOIUrl":null,"url":null,"abstract":"<div><p>Cities around the world are grappling with multiple interconnected challenges, including population growth, shortage of affordable and decent housing, and the need for neighborhood improvements. Despite its critical importance for policy, our ability to effectively monitor and track urban change remains limited. Deep learning-based computer vision methods applied to street-level images have been successful in the measurement of socioeconomic and environmental inequalities but did not fully utilize temporal images to track urban change, as time-varying labels are often unavailable. We used self-supervised methods to measure change in London using 15 million street images taken between 2008 and 2021. Our novel adaptation of Barlow Twins, Street2Vec, embeds urban structure while being invariant to seasonal and daily changes without manual annotations. It outperformed generic pretrained embeddings, successfully identified point-level change in London's housing supply from street-level images, and distinguished between major and minor change. This capability can provide timely information for urban planning and policy decisions towards more liveable, equitable, and sustainable cities.</p></div>","PeriodicalId":48241,"journal":{"name":"Computers Environment and Urban Systems","volume":"112 ","pages":"Article 102156"},"PeriodicalIF":7.1000,"publicationDate":"2024-07-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0198971524000851/pdfft?md5=7832e6057af071224448b12833b649b9&pid=1-s2.0-S0198971524000851-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Self-supervised learning unveils urban change from street-level images\",\"authors\":\"Steven Stalder , Michele Volpi , Nicolas Büttner , Stephen Law , Kenneth Harttgen , Esra Suel\",\"doi\":\"10.1016/j.compenvurbsys.2024.102156\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Cities around the world are grappling with multiple interconnected challenges, including population growth, shortage of affordable and decent housing, and the need for neighborhood improvements. Despite its critical importance for policy, our ability to effectively monitor and track urban change remains limited. Deep learning-based computer vision methods applied to street-level images have been successful in the measurement of socioeconomic and environmental inequalities but did not fully utilize temporal images to track urban change, as time-varying labels are often unavailable. We used self-supervised methods to measure change in London using 15 million street images taken between 2008 and 2021. Our novel adaptation of Barlow Twins, Street2Vec, embeds urban structure while being invariant to seasonal and daily changes without manual annotations. It outperformed generic pretrained embeddings, successfully identified point-level change in London's housing supply from street-level images, and distinguished between major and minor change. This capability can provide timely information for urban planning and policy decisions towards more liveable, equitable, and sustainable cities.</p></div>\",\"PeriodicalId\":48241,\"journal\":{\"name\":\"Computers Environment and Urban Systems\",\"volume\":\"112 \",\"pages\":\"Article 102156\"},\"PeriodicalIF\":7.1000,\"publicationDate\":\"2024-07-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S0198971524000851/pdfft?md5=7832e6057af071224448b12833b649b9&pid=1-s2.0-S0198971524000851-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computers Environment and Urban Systems\",\"FirstCategoryId\":\"89\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0198971524000851\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENVIRONMENTAL STUDIES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers Environment and Urban Systems","FirstCategoryId":"89","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0198971524000851","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENVIRONMENTAL STUDIES","Score":null,"Total":0}
Self-supervised learning unveils urban change from street-level images
Cities around the world are grappling with multiple interconnected challenges, including population growth, shortage of affordable and decent housing, and the need for neighborhood improvements. Despite its critical importance for policy, our ability to effectively monitor and track urban change remains limited. Deep learning-based computer vision methods applied to street-level images have been successful in the measurement of socioeconomic and environmental inequalities but did not fully utilize temporal images to track urban change, as time-varying labels are often unavailable. We used self-supervised methods to measure change in London using 15 million street images taken between 2008 and 2021. Our novel adaptation of Barlow Twins, Street2Vec, embeds urban structure while being invariant to seasonal and daily changes without manual annotations. It outperformed generic pretrained embeddings, successfully identified point-level change in London's housing supply from street-level images, and distinguished between major and minor change. This capability can provide timely information for urban planning and policy decisions towards more liveable, equitable, and sustainable cities.
期刊介绍:
Computers, Environment and Urban Systemsis an interdisciplinary journal publishing cutting-edge and innovative computer-based research on environmental and urban systems, that privileges the geospatial perspective. The journal welcomes original high quality scholarship of a theoretical, applied or technological nature, and provides a stimulating presentation of perspectives, research developments, overviews of important new technologies and uses of major computational, information-based, and visualization innovations. Applied and theoretical contributions demonstrate the scope of computer-based analysis fostering a better understanding of environmental and urban systems, their spatial scope and their dynamics.