{"title":"3D Head Pose Estimation via Normal Maps: A Generalized Solution for Depth Image, Point Cloud, and Mesh","authors":"Jiang Wu, Hua Chen","doi":"10.1002/aisy.202400159","DOIUrl":"https://doi.org/10.1002/aisy.202400159","url":null,"abstract":"<p>Head pose estimation plays a crucial role in various applications, including human–machine interaction, autonomous driving systems, and 3D reconstruction. Current methods address the problem primarily from a 2D perspective, which limits the efficient utilization of 3D information. Herein, a novel approach, called pose orientation-aware network (POANet), which leverages normal maps for orientation information embedding, providing abundant and robust head pose information, is introduced. POANet incorporates the axial signal perception module and the rotation matrix perception module, these lightweight modules make the approach achieve state-of-the-art (SOTA) performance with few computational costs. This method can directly analyze various topological 3D data without extensive preprocessing. For depth images, POANet outperforms existing methods on the Biwi Kinect head pose dataset, reducing the mean absolute error (MAE) by ≈30% compared to the SOTA methods. POANet is the first method to perform rigid head registration in a landmark-free manner. It also incorporates few-shot learning capabilities and achieves an MAE of about <span></span><math>\u0000 <semantics>\u0000 <mrow>\u0000 <mn>1</mn>\u0000 <mo>°</mo>\u0000 </mrow>\u0000 <annotation>$1^{circ}$</annotation>\u0000 </semantics></math> on the Headspace dataset. These features make POANet a superior alternative to traditional generalized Procrustes analysis for mesh data processing, offering enhanced convenience for human phenotype studies.</p>","PeriodicalId":93858,"journal":{"name":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","volume":"6 11","pages":""},"PeriodicalIF":6.8,"publicationDate":"2024-10-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aisy.202400159","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142664857","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Haofan Huang, Qi Zhao, Huanhao Li, Yuandong Zheng, Zhipeng Yu, Tianting Zhong, Shengfu Cheng, Chi Man Woo, Yi Gao, Honglin Liu, Yuanjin Zheng, Jie Tian, Puxiang Lai
{"title":"DeepSLM: Speckle-Licensed Modulation via Deep Adversarial Learning for Authorized Optical Encryption and Decryption","authors":"Haofan Huang, Qi Zhao, Huanhao Li, Yuandong Zheng, Zhipeng Yu, Tianting Zhong, Shengfu Cheng, Chi Man Woo, Yi Gao, Honglin Liu, Yuanjin Zheng, Jie Tian, Puxiang Lai","doi":"10.1002/aisy.202400150","DOIUrl":"https://doi.org/10.1002/aisy.202400150","url":null,"abstract":"<p>Optical encryption is pivotal in information security, offering parallel processing, speed, and robust security. The simplicity and compatibility of speckle-based cryptosystems have garnered considerable attention. Yet, the predictable statistical distribution of speckle optical fields’ characteristics can invite statistical attacks, undermining these encryption methods. The proposed solution, a deep adversarial learning-based speckle modulation network (DeepSLM), disrupts the strong intercorrelation of speckle grains. Utilizing the unique encoding properties of speckle patterns, DeepSLM facilitates license editing within the modulation phase, pioneering a layered authentication encryption system. Our empirical studies confirm DeepSLM's superior performance on key metrics. Notably, the testing dataset reveals an average Pearson correlation coefficient above 0.97 between decrypted images and their original counterparts for intricate subjects like human faces, attesting to the method's high fidelity. This innovation marries adjustable modification, optical encryption, and deep learning to enforce tiered data access control, charting new paths for creating user-specific access protocols.</p>","PeriodicalId":93858,"journal":{"name":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","volume":"6 11","pages":""},"PeriodicalIF":6.8,"publicationDate":"2024-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aisy.202400150","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142665164","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Marcos Maroto-Gómez, Enrique Fernández-Rodicio, Álvaro Castro-González, María Malfaz, Miguel Ángel Salichs
{"title":"Evaluating Users’ Perception of Biologically Inspired Involuntary Behavior in Human–Robot Interaction","authors":"Marcos Maroto-Gómez, Enrique Fernández-Rodicio, Álvaro Castro-González, María Malfaz, Miguel Ángel Salichs","doi":"10.1002/aisy.202400042","DOIUrl":"https://doi.org/10.1002/aisy.202400042","url":null,"abstract":"<p>Multimodal communication is a human feature that enables diverse interactions. In human–robot interaction (HRI), robots have to communicate using human skills so that they can seem natural and assist effectively. Most research uses predefined gestures to equip robots with social abilities. However, researchers scarcely consider generating bioinspired involuntary behavior to improve a robot's expressiveness and communication. Human studies revealed that involuntary behavior affects how others perceive communicative intentions. Therefore, mimicking human involuntary behavior may positively affect HRI. This article extends our previous work on equipping robots with involuntary behavior with a user study that evaluates the use of bioinspiration for complementing gestures. A preliminary test is conducted with 15 participants to determine if they can perceive the intensities of the involuntary processes heart rate, pupil size, blink rate, breathing rate, and motor activity. 63 new participants interacted with a robot with bioinspired behaviors or a robot only showing predefined gestures to evaluate the robots’ warmth, competence, and discomfort. The results show that the preliminary test participants differentiated the intensities of the involuntary processes. Participants in the second study find the robot with bioinspired behaviors significantly warmer and more competent than the robot with predefined gestures, with no discomfort difference.</p>","PeriodicalId":93858,"journal":{"name":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","volume":"6 10","pages":""},"PeriodicalIF":6.8,"publicationDate":"2024-09-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aisy.202400042","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142443492","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Abdul Rahman Sani, Ali Zolfagharian, Abbas Z. Kouzani
{"title":"Artificial Intelligence-Augmented Additive Manufacturing: Insights on Closed-Loop 3D Printing","authors":"Abdul Rahman Sani, Ali Zolfagharian, Abbas Z. Kouzani","doi":"10.1002/aisy.202400102","DOIUrl":"https://doi.org/10.1002/aisy.202400102","url":null,"abstract":"<p>The advent of 3D printing has transformed manufacturing. However, extending the library of materials to improve 3D printing quality remains a challenge. Defects can occur when printing parameters like print speed and temperature are chosen incorrectly. These can cause structural or dimensional issues in the final product. This review investigates closed-loop artificial intelligence-augmented additive manufacturing (AI2AM) technology that integrates AI-based monitoring, automation, and optimization of printing parameters and processes. AI2AM uses AI to improve defect detection and prevention, improving additive manufacturing quality and efficiency. This article explores generic 3D printing processes and issues using existing research and developments. Next, it focuses on fused deposition modeling (FDM) printers and reviews their parameters and issues. The current remedies developed for defect detection and monitoring in FDM 3D printers are presented. Then, the article investigates AI-based 3D printing monitoring, closed-loop feedback systems, and parameter optimization development. Finally, closed-loop 3D printing challenges and future directions are discussed. AI-based systems detect and correct 3D printing failures, enabling current printers to operate within optimal conditions and minimizing the risk of defects or failures, which in turn leads to more sustainable manufacturing with minimum waste and extending the library of materials.</p>","PeriodicalId":93858,"journal":{"name":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","volume":"6 10","pages":""},"PeriodicalIF":6.8,"publicationDate":"2024-09-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aisy.202400102","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142443598","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Looming Detection in Complex Dynamic Visual Scenes by Interneuronal Coordination of Motion and Feature Pathways","authors":"Bo Gu, Jianfeng Feng, Zhuoyi Song","doi":"10.1002/aisy.202470041","DOIUrl":"https://doi.org/10.1002/aisy.202470041","url":null,"abstract":"<p><b>Looming Detection in Complex Dynamic Visual Scenes</b>\u0000 </p><p>A novel fly-inspired neural network unleashes an incredibly enhanced looming detection performance in dynamic environments with converged neuro-dynamics, highlighting how the magic coordination of motion and feature signals helps reduce interference. For further details, see article number 2400198 by Bo Gu, Jianfeng Feng, and Zhuoyi Song.\u0000\u0000 <figure>\u0000 <div><picture>\u0000 <source></source></picture><p></p>\u0000 </div>\u0000 </figure></p>","PeriodicalId":93858,"journal":{"name":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","volume":"6 9","pages":""},"PeriodicalIF":6.8,"publicationDate":"2024-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aisy.202470041","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142316868","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Qin Fang, Jingyu Zhang, Pingyu Xiang, Nenggan Zheng, Yue Wang, Rong Xiong, Zhefeng Gong, Haojian Lu
{"title":"Reconfigurable Transparent Variable-Stiffness Soft Robot for Underwater Operations","authors":"Qin Fang, Jingyu Zhang, Pingyu Xiang, Nenggan Zheng, Yue Wang, Rong Xiong, Zhefeng Gong, Haojian Lu","doi":"10.1002/aisy.202470040","DOIUrl":"https://doi.org/10.1002/aisy.202470040","url":null,"abstract":"<p><b>Soft Underwater Robots</b>\u0000 </p><p>Soft robots hold great significance for underwater operations due to their exceptional compliance and adaptability. In article number 2300688, Qin Fang, Zhefeng Gong, Haojian Lu, and co-workers introduce a transparent reconfigurable soft underwater robot with variable stiffness capability. The cover image shows a soft gripper for delicate underwater grasping and a soft manipulator for exploration in confined underwater environments, highlighting the robot’s potential for future underwater applications.\u0000\u0000 <figure>\u0000 <div><picture>\u0000 <source></source></picture><p></p>\u0000 </div>\u0000 </figure></p>","PeriodicalId":93858,"journal":{"name":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","volume":"6 9","pages":""},"PeriodicalIF":6.8,"publicationDate":"2024-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aisy.202470040","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142316910","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Tactile Sensing and Grasping Through Thin-Shell Buckling","authors":"Kieran Barvenik, Zachary Coogan, Gabriele Librandi, Matteo Pezzulla, Eleonora Tubaldi","doi":"10.1002/aisy.202470044","DOIUrl":"https://doi.org/10.1002/aisy.202470044","url":null,"abstract":"<p><b>Tactile Sensing and Grasping Through Thin-Shell Buckling</b>\u0000 </p><p>Soft, hemispherical grippers create new opportunities for blending delicate manipulation with intrinsic tactile sensing. Inspired by deep-sea predatory tunicates, the fluidic hemispherical grippers provide a novel solution to the challenge of universal grasping with a unique sense of touch based on the principles of thin shell buckling. The simple device can passively detect environmental information solely by monitoring its internal fluid pressure, which opens new avenues for designing low-cost soft devices in applications ranging from medical robotics to underwater exploration. For more information, see article number 2300855 by Eleonora Tubaldi and co-workers.\u0000\u0000 <figure>\u0000 <div><picture>\u0000 <source></source></picture><p></p>\u0000 </div>\u0000 </figure></p>","PeriodicalId":93858,"journal":{"name":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","volume":"6 9","pages":""},"PeriodicalIF":6.8,"publicationDate":"2024-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aisy.202470044","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142316870","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Daniele De Pasquale, Attilio Marino, Carlotta Pucci, Omar Tricinci, Carlo Filippeschi, Pietro Fiaschi, Edoardo Sinibaldi, Gianni Ciofani
{"title":"Remotely Controlled 3D-Engineered Scaffolds for Biomimetic In Vitro Investigations on Brain Cell Cocultures","authors":"Daniele De Pasquale, Attilio Marino, Carlotta Pucci, Omar Tricinci, Carlo Filippeschi, Pietro Fiaschi, Edoardo Sinibaldi, Gianni Ciofani","doi":"10.1002/aisy.202470043","DOIUrl":"https://doi.org/10.1002/aisy.202470043","url":null,"abstract":"<p><b>Magneto-Responsive Scaffolds for Biomimetic Investigations</b>\u0000 </p><p>In article number 2400261, Daniele De Pasquale, Edoardo Sinibaldi, Gianni Ciofani, and co-workers present geometrically engineered scaffolds fabricated with magneto-responsive materials, exploited for co-culturing glioma and healthy brain cells. The proposed structures are able to sustain 3D cultures and, thanks to the magnetic properties, allow their remote manipulation.\u0000\u0000 <figure>\u0000 <div><picture>\u0000 <source></source></picture><p></p>\u0000 </div>\u0000 </figure></p>","PeriodicalId":93858,"journal":{"name":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","volume":"6 9","pages":""},"PeriodicalIF":6.8,"publicationDate":"2024-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aisy.202470043","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142316869","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Zhiwei Yu, Xiaofeng Xu, Benhua Zhao, Jiahui Fu, Linfeng Wang, Zhouyi Wang, Chengguang Fan, Simon X. Yang, Aihong Ji
{"title":"A Gecko-Inspired Robot Using Novel Variable-Stiffness Adhesive Paw Can Climb on Rough/Smooth Surfaces in Microgravity","authors":"Zhiwei Yu, Xiaofeng Xu, Benhua Zhao, Jiahui Fu, Linfeng Wang, Zhouyi Wang, Chengguang Fan, Simon X. Yang, Aihong Ji","doi":"10.1002/aisy.202400043","DOIUrl":"https://doi.org/10.1002/aisy.202400043","url":null,"abstract":"<p>Space-wall-climbing robots face the challenge of stably attaching to and moving on spacecraft surfaces, which include smooth flat areas and rough intricate surfaces. Although adhesion-based wall-climbing robots demonstrate stable climbing on smooth surfaces in outer space, there is scarce research on their stable adhesion on rough surfaces within a microgravity environment. A novel adhesive material is developed inspired by the adhesion mechanism and locomotion of the <i>Gekko</i> gecko. This material exhibits exceptional adhesion across various materials and surface roughness. A variable-stiffness gecko-inspired paw is engineered, generating substantial adhesion forces while minimizing detachment forces. Impressively, this paw generates up to 180 N of adhesion force on smooth surfaces and achieves detachment without external forces. By integrating such variable-stiffness paws with a wall-climbing robot, a gecko-inspired robot effectively operating in a microgravity environment is created. The robotic satellite surface climbing experiments and robotic satellite capture experiments are conducted using a simulated microgravity environment and a satellite model. The results unequivocally demonstrate the gecko-inspired robot's proficiency in executing various functions, including stable motion and capture on both smooth and rough spacecraft surfaces within a microgravity environment. These experiments underscore the potential of adhesion-based gecko-inspired robots for in-orbit services and spacecraft capture and recovery.</p>","PeriodicalId":93858,"journal":{"name":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","volume":"6 10","pages":""},"PeriodicalIF":6.8,"publicationDate":"2024-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aisy.202400043","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142443370","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
A. Merritt Brooks, Sungyun Yang, Byung Ha Kang, Michael S. Strano
{"title":"A Microrobotic Design for the Spontaneous Tracing of Isochemical Contours in the Environment","authors":"A. Merritt Brooks, Sungyun Yang, Byung Ha Kang, Michael S. Strano","doi":"10.1002/aisy.202400002","DOIUrl":"https://doi.org/10.1002/aisy.202400002","url":null,"abstract":"<p>Microrobotic platforms hold significant potential to advance a variety of fields, from medicine to environmental sensing. Herein, minimally functional robotic entities modeled on readily achievable state-of-the-art features in a modern lab or cleanroom are computationally simulated. Inspired by Dou and Bishop (<i>Phys Rev Res</i>. 2019;1(3):1–5), it is shown that the simple combination of unidirectional steering connected to a single environmental (chemical) sensor along with constant propulsion gives rise to highly complex functions of significant utility. Such systems can trace the contours orthogonal to arbitrary chemical gradients in the environment. Also, pairs of such robots that are additionally capable of emitting the same chemical signal are shown to exhibit coupled relative motion. When the pair has unidirectional steering in opposite directions within the 2D plane (i.e., counter-rotating), they move in parallel trajectories to each other. Alternatively, when steering is in the same direction (corotation), the two move in the same epicyclical trajectory. In this way, the chirality of the unidirectional steering produces two distinct emergent phenomena. The behavior is understood as a ratchet mechanism that exploits the differential in the radii of curvature corresponding to different spatial locations. Applications to environmental detection, remediation, and monitoring are discussed.</p>","PeriodicalId":93858,"journal":{"name":"Advanced intelligent systems (Weinheim an der Bergstrasse, Germany)","volume":"6 10","pages":""},"PeriodicalIF":6.8,"publicationDate":"2024-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aisy.202400002","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142443497","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}