Xiang Dai, Kyrollos Yanny, Kristina Monakhova, Nicholas Antipa
{"title":"单镜头HDR使用传统的图像传感器快门功能和光学随机化","authors":"Xiang Dai, Kyrollos Yanny, Kristina Monakhova, Nicholas Antipa","doi":"10.1145/3748718","DOIUrl":null,"url":null,"abstract":"High-dynamic-range (HDR) imaging is an essential technique for overcoming the dynamic range limits of image sensors. The classic method relies on multiple exposures, which slows capture time, resulting in motion artifacts when imaging dynamic scenes. Single-shot HDR imaging alleviates this issue by encoding HDR data in a single exposure, then computationally recovering it. Many established methods use strong image priors to recover improperly exposed detail; these approaches struggle with extended highlight regions. In this work, we demonstrate a novel single-shot HDR capture method that utilizes the <jats:italic toggle=\"yes\">global reset release</jats:italic> (GRR) shutter mode commonly found in off-the-shelf sensors. GRR shutter mode applies a longer exposure time to rows closer to the bottom of the sensor. We use optics that relay a randomly permuted (shuffled) image onto the sensor, effectively creating spatially randomized exposures across the scene. The resulting exposure diversity allows us to recover HDR data by solving an optimization problem with a simple total variation image prior. In simulation, we demonstrate that our method outperforms other single-shot methods when many sensor pixels are saturated (10 <jats:inline-formula content-type=\"math/tex\"> <jats:tex-math notation=\"TeX\" version=\"MathJaX\">\\(\\% \\)</jats:tex-math> </jats:inline-formula> or more), and is competitive at modest saturation (1 <jats:inline-formula content-type=\"math/tex\"> <jats:tex-math notation=\"TeX\" version=\"MathJaX\">\\(\\% \\)</jats:tex-math> </jats:inline-formula> ). Finally, we demonstrate a physical lab prototype that uses an off-the-shelf random fiber bundle for the optical shuffling. The fiber bundle is coupled to a low-cost commercial sensor operating in GRR shutter mode. Our prototype achieves a dynamic range of up to 73dB using an 8-bit sensor with 48dB dynamic range.","PeriodicalId":50913,"journal":{"name":"ACM Transactions on Graphics","volume":"14 1","pages":""},"PeriodicalIF":9.5000,"publicationDate":"2025-07-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Single-shot HDR using conventional image sensor shutter functions and optical randomization\",\"authors\":\"Xiang Dai, Kyrollos Yanny, Kristina Monakhova, Nicholas Antipa\",\"doi\":\"10.1145/3748718\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"High-dynamic-range (HDR) imaging is an essential technique for overcoming the dynamic range limits of image sensors. The classic method relies on multiple exposures, which slows capture time, resulting in motion artifacts when imaging dynamic scenes. Single-shot HDR imaging alleviates this issue by encoding HDR data in a single exposure, then computationally recovering it. Many established methods use strong image priors to recover improperly exposed detail; these approaches struggle with extended highlight regions. In this work, we demonstrate a novel single-shot HDR capture method that utilizes the <jats:italic toggle=\\\"yes\\\">global reset release</jats:italic> (GRR) shutter mode commonly found in off-the-shelf sensors. GRR shutter mode applies a longer exposure time to rows closer to the bottom of the sensor. We use optics that relay a randomly permuted (shuffled) image onto the sensor, effectively creating spatially randomized exposures across the scene. The resulting exposure diversity allows us to recover HDR data by solving an optimization problem with a simple total variation image prior. In simulation, we demonstrate that our method outperforms other single-shot methods when many sensor pixels are saturated (10 <jats:inline-formula content-type=\\\"math/tex\\\"> <jats:tex-math notation=\\\"TeX\\\" version=\\\"MathJaX\\\">\\\\(\\\\% \\\\)</jats:tex-math> </jats:inline-formula> or more), and is competitive at modest saturation (1 <jats:inline-formula content-type=\\\"math/tex\\\"> <jats:tex-math notation=\\\"TeX\\\" version=\\\"MathJaX\\\">\\\\(\\\\% \\\\)</jats:tex-math> </jats:inline-formula> ). Finally, we demonstrate a physical lab prototype that uses an off-the-shelf random fiber bundle for the optical shuffling. The fiber bundle is coupled to a low-cost commercial sensor operating in GRR shutter mode. Our prototype achieves a dynamic range of up to 73dB using an 8-bit sensor with 48dB dynamic range.\",\"PeriodicalId\":50913,\"journal\":{\"name\":\"ACM Transactions on Graphics\",\"volume\":\"14 1\",\"pages\":\"\"},\"PeriodicalIF\":9.5000,\"publicationDate\":\"2025-07-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ACM Transactions on Graphics\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.1145/3748718\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, SOFTWARE ENGINEERING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACM Transactions on Graphics","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1145/3748718","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, SOFTWARE ENGINEERING","Score":null,"Total":0}
Single-shot HDR using conventional image sensor shutter functions and optical randomization
High-dynamic-range (HDR) imaging is an essential technique for overcoming the dynamic range limits of image sensors. The classic method relies on multiple exposures, which slows capture time, resulting in motion artifacts when imaging dynamic scenes. Single-shot HDR imaging alleviates this issue by encoding HDR data in a single exposure, then computationally recovering it. Many established methods use strong image priors to recover improperly exposed detail; these approaches struggle with extended highlight regions. In this work, we demonstrate a novel single-shot HDR capture method that utilizes the global reset release (GRR) shutter mode commonly found in off-the-shelf sensors. GRR shutter mode applies a longer exposure time to rows closer to the bottom of the sensor. We use optics that relay a randomly permuted (shuffled) image onto the sensor, effectively creating spatially randomized exposures across the scene. The resulting exposure diversity allows us to recover HDR data by solving an optimization problem with a simple total variation image prior. In simulation, we demonstrate that our method outperforms other single-shot methods when many sensor pixels are saturated (10 \(\% \) or more), and is competitive at modest saturation (1 \(\% \) ). Finally, we demonstrate a physical lab prototype that uses an off-the-shelf random fiber bundle for the optical shuffling. The fiber bundle is coupled to a low-cost commercial sensor operating in GRR shutter mode. Our prototype achieves a dynamic range of up to 73dB using an 8-bit sensor with 48dB dynamic range.
期刊介绍:
ACM Transactions on Graphics (TOG) is a peer-reviewed scientific journal that aims to disseminate the latest findings of note in the field of computer graphics. It has been published since 1982 by the Association for Computing Machinery. Starting in 2003, all papers accepted for presentation at the annual SIGGRAPH conference are printed in a special summer issue of the journal.