用多焦点相机阵列记录动态面部微表情。

IF 2.9 2区 医学 Q2 BIOCHEMICAL RESEARCH METHODS
Biomedical optics express Pub Date : 2025-01-17 eCollection Date: 2025-02-01 DOI:10.1364/BOE.547944
Lucas Kreiss, Weiheng Tang, Ramana Balla, Xi Yang, Amey Chaware, Kanghyun Kim, Clare B Cook, Aurelien Begue, Clay Dugo, Mark Harfouche, Kevin C Zhou, Roarke Horstmeyer
{"title":"用多焦点相机阵列记录动态面部微表情。","authors":"Lucas Kreiss, Weiheng Tang, Ramana Balla, Xi Yang, Amey Chaware, Kanghyun Kim, Clare B Cook, Aurelien Begue, Clay Dugo, Mark Harfouche, Kevin C Zhou, Roarke Horstmeyer","doi":"10.1364/BOE.547944","DOIUrl":null,"url":null,"abstract":"<p><p>We present a multi-camera array for capturing dynamic high-resolution videos of the human face. Compared to traditional single-camera configurations, our array of 54 individual cameras allows stitching of high-resolution composite video frames (709 megapixels total). In our novel multi-focus strategy, each camera in the array focuses on a unique object plane to resolve non-planar surfaces at a higher resolution than a standard single-lens camera design. By overcoming the standard resolution and depth-of-field (DOF) tradeoffs, we use our array design to capture video of macroscopically curved surfaces such as the human face at a lateral resolution of 26.14 ± 5.8 µm across a composite DOF of ∼43 mm that covers the entire face (85 cm<sup>2</sup>+ FOV). Compared to a single-focus configuration, this is almost a 10-fold increase in effective DOF. We demonstrate how our multi-focus camera array can capture dynamic facial expressions at microscopic resolution with relevance in several biomedical applications.</p>","PeriodicalId":8969,"journal":{"name":"Biomedical optics express","volume":"16 2","pages":"617-627"},"PeriodicalIF":2.9000,"publicationDate":"2025-01-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11828449/pdf/","citationCount":"0","resultStr":"{\"title\":\"Recording dynamic facial micro-expressions with a multi-focus camera array.\",\"authors\":\"Lucas Kreiss, Weiheng Tang, Ramana Balla, Xi Yang, Amey Chaware, Kanghyun Kim, Clare B Cook, Aurelien Begue, Clay Dugo, Mark Harfouche, Kevin C Zhou, Roarke Horstmeyer\",\"doi\":\"10.1364/BOE.547944\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>We present a multi-camera array for capturing dynamic high-resolution videos of the human face. Compared to traditional single-camera configurations, our array of 54 individual cameras allows stitching of high-resolution composite video frames (709 megapixels total). In our novel multi-focus strategy, each camera in the array focuses on a unique object plane to resolve non-planar surfaces at a higher resolution than a standard single-lens camera design. By overcoming the standard resolution and depth-of-field (DOF) tradeoffs, we use our array design to capture video of macroscopically curved surfaces such as the human face at a lateral resolution of 26.14 ± 5.8 µm across a composite DOF of ∼43 mm that covers the entire face (85 cm<sup>2</sup>+ FOV). Compared to a single-focus configuration, this is almost a 10-fold increase in effective DOF. We demonstrate how our multi-focus camera array can capture dynamic facial expressions at microscopic resolution with relevance in several biomedical applications.</p>\",\"PeriodicalId\":8969,\"journal\":{\"name\":\"Biomedical optics express\",\"volume\":\"16 2\",\"pages\":\"617-627\"},\"PeriodicalIF\":2.9000,\"publicationDate\":\"2025-01-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11828449/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Biomedical optics express\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1364/BOE.547944\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/2/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"Q2\",\"JCRName\":\"BIOCHEMICAL RESEARCH METHODS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biomedical optics express","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1364/BOE.547944","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/2/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"BIOCHEMICAL RESEARCH METHODS","Score":null,"Total":0}
引用次数: 0

摘要

我们提出了一种多摄像头阵列,用于捕捉人脸的动态高分辨率视频。与传统的单摄像头配置相比,我们的54个独立摄像头阵列允许拼接高分辨率合成视频帧(总计7.09亿像素)。在我们新颖的多焦点策略中,阵列中的每个相机聚焦在一个独特的物体平面上,以比标准单镜头相机设计更高的分辨率解决非平面表面。通过克服标准分辨率和景深(DOF)的权衡,我们使用我们的阵列设计来捕获宏观曲面的视频,如人脸,横向分辨率为26.14±5.8µm,复合DOF为~ 43 mm,覆盖整个面部(85 cm2+ FOV)。与单焦点配置相比,这几乎是有效景深的10倍增加。我们展示了我们的多焦点相机阵列如何在微观分辨率下捕捉动态面部表情,并与几个生物医学应用相关。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Recording dynamic facial micro-expressions with a multi-focus camera array.

We present a multi-camera array for capturing dynamic high-resolution videos of the human face. Compared to traditional single-camera configurations, our array of 54 individual cameras allows stitching of high-resolution composite video frames (709 megapixels total). In our novel multi-focus strategy, each camera in the array focuses on a unique object plane to resolve non-planar surfaces at a higher resolution than a standard single-lens camera design. By overcoming the standard resolution and depth-of-field (DOF) tradeoffs, we use our array design to capture video of macroscopically curved surfaces such as the human face at a lateral resolution of 26.14 ± 5.8 µm across a composite DOF of ∼43 mm that covers the entire face (85 cm2+ FOV). Compared to a single-focus configuration, this is almost a 10-fold increase in effective DOF. We demonstrate how our multi-focus camera array can capture dynamic facial expressions at microscopic resolution with relevance in several biomedical applications.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Biomedical optics express
Biomedical optics express BIOCHEMICAL RESEARCH METHODS-OPTICS
CiteScore
6.80
自引率
11.80%
发文量
633
审稿时长
1 months
期刊介绍: The journal''s scope encompasses fundamental research, technology development, biomedical studies and clinical applications. BOEx focuses on the leading edge topics in the field, including: Tissue optics and spectroscopy Novel microscopies Optical coherence tomography Diffuse and fluorescence tomography Photoacoustic and multimodal imaging Molecular imaging and therapies Nanophotonic biosensing Optical biophysics/photobiology Microfluidic optical devices Vision research.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信