Marco Santos-Lopes, Ricardo Araújo, Romain David, Paulo L Correia
{"title":"无约束环境下鸟类头部运动的自动分析:始祖恐龙半规管进化的基础研究。","authors":"Marco Santos-Lopes, Ricardo Araújo, Romain David, Paulo L Correia","doi":"10.1098/rsif.2024.0919","DOIUrl":null,"url":null,"abstract":"<p><p>This study presents a framework to automatically analyse head motion in birds from videos of natural behaviours. The process involves detecting birds, identifying key points on their heads and tracking changes in their positions over time. Bird detection and key point extraction were trained on publicly available datasets, featuring videos and images of diverse bird species in uncontrolled settings. Initial challenges with complex video backgrounds causing misidentifications and inaccurate key points were addressed through validation, refinement, filtering and smoothing. Head angular velocities and rotation frequencies were computed from the refined key points. The algorithm performed well at moderate speeds but was limited by the 30 Hz frame rate of most videos, which constrained measurable angular velocities and frequencies and caused motion blur, affecting key point detection. Our findings suggest that the framework may provide plausible estimates of head motion but also emphasize the importance of high frame-rate videos in future research, including extensive comparisons against ground truth data, to fully characterize bird head movements. Importantly, this work is a foundational effort to understand the evolutionary drivers of the semicircular canals, the biosensor that monitors head rotations, for both extinct and extant tetrapods.</p>","PeriodicalId":17488,"journal":{"name":"Journal of The Royal Society Interface","volume":"22 226","pages":"20240919"},"PeriodicalIF":3.5000,"publicationDate":"2025-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12115815/pdf/","citationCount":"0","resultStr":"{\"title\":\"Automated analysis of bird head motion in unconstrained settings: a foundational study on semicircular canal evolution in archosaurs.\",\"authors\":\"Marco Santos-Lopes, Ricardo Araújo, Romain David, Paulo L Correia\",\"doi\":\"10.1098/rsif.2024.0919\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>This study presents a framework to automatically analyse head motion in birds from videos of natural behaviours. The process involves detecting birds, identifying key points on their heads and tracking changes in their positions over time. Bird detection and key point extraction were trained on publicly available datasets, featuring videos and images of diverse bird species in uncontrolled settings. Initial challenges with complex video backgrounds causing misidentifications and inaccurate key points were addressed through validation, refinement, filtering and smoothing. Head angular velocities and rotation frequencies were computed from the refined key points. The algorithm performed well at moderate speeds but was limited by the 30 Hz frame rate of most videos, which constrained measurable angular velocities and frequencies and caused motion blur, affecting key point detection. Our findings suggest that the framework may provide plausible estimates of head motion but also emphasize the importance of high frame-rate videos in future research, including extensive comparisons against ground truth data, to fully characterize bird head movements. Importantly, this work is a foundational effort to understand the evolutionary drivers of the semicircular canals, the biosensor that monitors head rotations, for both extinct and extant tetrapods.</p>\",\"PeriodicalId\":17488,\"journal\":{\"name\":\"Journal of The Royal Society Interface\",\"volume\":\"22 226\",\"pages\":\"20240919\"},\"PeriodicalIF\":3.5000,\"publicationDate\":\"2025-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12115815/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of The Royal Society Interface\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://doi.org/10.1098/rsif.2024.0919\",\"RegionNum\":2,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/5/28 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"MULTIDISCIPLINARY SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of The Royal Society Interface","FirstCategoryId":"103","ListUrlMain":"https://doi.org/10.1098/rsif.2024.0919","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/5/28 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
Automated analysis of bird head motion in unconstrained settings: a foundational study on semicircular canal evolution in archosaurs.
This study presents a framework to automatically analyse head motion in birds from videos of natural behaviours. The process involves detecting birds, identifying key points on their heads and tracking changes in their positions over time. Bird detection and key point extraction were trained on publicly available datasets, featuring videos and images of diverse bird species in uncontrolled settings. Initial challenges with complex video backgrounds causing misidentifications and inaccurate key points were addressed through validation, refinement, filtering and smoothing. Head angular velocities and rotation frequencies were computed from the refined key points. The algorithm performed well at moderate speeds but was limited by the 30 Hz frame rate of most videos, which constrained measurable angular velocities and frequencies and caused motion blur, affecting key point detection. Our findings suggest that the framework may provide plausible estimates of head motion but also emphasize the importance of high frame-rate videos in future research, including extensive comparisons against ground truth data, to fully characterize bird head movements. Importantly, this work is a foundational effort to understand the evolutionary drivers of the semicircular canals, the biosensor that monitors head rotations, for both extinct and extant tetrapods.
期刊介绍:
J. R. Soc. Interface welcomes articles of high quality research at the interface of the physical and life sciences. It provides a high-quality forum to publish rapidly and interact across this boundary in two main ways: J. R. Soc. Interface publishes research applying chemistry, engineering, materials science, mathematics and physics to the biological and medical sciences; it also highlights discoveries in the life sciences of relevance to the physical sciences. Both sides of the interface are considered equally and it is one of the only journals to cover this exciting new territory. J. R. Soc. Interface welcomes contributions on a diverse range of topics, including but not limited to; biocomplexity, bioengineering, bioinformatics, biomaterials, biomechanics, bionanoscience, biophysics, chemical biology, computer science (as applied to the life sciences), medical physics, synthetic biology, systems biology, theoretical biology and tissue engineering.