Xueqian Zhai, Qihao Feng, Haochen Zheng, Yi Luo, Huikun Hao, An Yan, Hongmin Wu
{"title":"Contact-aware multi-skill learning framework with hybrid force-motion control for stability and force regulation in robotic physiotherapy.","authors":"Xueqian Zhai, Qihao Feng, Haochen Zheng, Yi Luo, Huikun Hao, An Yan, Hongmin Wu","doi":"10.3389/frobt.2026.1892296","DOIUrl":"https://doi.org/10.3389/frobt.2026.1892296","url":null,"abstract":"<p><p>Robot-assisted physiotherapy has attracted increasing attention for its potential to provide repeatable, stable, and controllable physical interaction during rehabilitation-oriented therapy. However, contact-rich physiotherapy tasks remain challenging because the robot must reproduce therapist-demonstrated massage skills while adapting to non-planar and deformable body surfaces, suppressing impact during contact transition, and maintaining stable force regulation. This paper proposes a contact-aware robot-assisted physiotherapy framework that integrates task-space skill generalization, contact state estimation, dynamic velocity adjustment, force-error compensation, and bounded variable impedance control. Therapist-guided demonstrations are encoded using Dynamic Movement Primitives (DMPs) to construct a physiotherapy skill library, enabling typical massage skills, including kneading, patting, pushing, and pressing, to be generalized to new start and goal points in the robot Cartesian task space. During execution, force/torque feedback is used to estimate the contact point and surface normal, update the local task frame, regulate the approach velocity, and compensate for force-tracking errors. Experimental validation was conducted on a silicone abdominal model and in a preliminary healthy-volunteer back physiotherapy test. The results show that the proposed dynamic contact strategy suppresses excessive impact during contact transition, avoiding the <math><mrow><mn>165.86</mn> <mtext> </mtext> <mi>N</mi></mrow> </math> peak impact observed under high-speed contact. The force compensation strategy reduces the force-tracking RMSE from <math><mrow><mn>0.835</mn> <mtext> </mtext> <mi>N</mi></mrow> </math> to <math><mrow><mn>0.395</mn> <mtext> </mtext> <mi>N</mi></mrow> </math> , corresponding to a <math><mrow><mn>52.69</mn> <mi>%</mi></mrow> </math> improvement. In addition, the bounded variable impedance strategy improves motion-force coordination compared with fixed-stiffness control. These results demonstrate that the proposed framework improves contact transition safety, force regulation accuracy, and task adaptability at the control-performance level, providing a feasible basis for further development of robotic physiotherapy systems.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"13 ","pages":"1892296"},"PeriodicalIF":3.7,"publicationDate":"2026-08-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13490941/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148799651","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
R Bakzadeh, V Androulakis, H Khaniani, S Shao, M Hassanalian, P Roghanchi
{"title":"Robots in mine search and rescue operations: a review of platforms and design requirements.","authors":"R Bakzadeh, V Androulakis, H Khaniani, S Shao, M Hassanalian, P Roghanchi","doi":"10.3389/frobt.2026.1857704","DOIUrl":"https://doi.org/10.3389/frobt.2026.1857704","url":null,"abstract":"<p><p>The use of automation in mining can be found at all stages of the mining process, covering exploration, excavation, loading, transportation, mineral processing, and search and rescue missions in emergency situations. Due to the harsh conditions during an underground mine disaster, robots can be of great assistance to rescue teams by entering areas that are unsafe for human rescuers, locating trapped workers, and collecting valuable data. The design and implementation of coal-mine rescue robots are characterized by great complexity because they encompass a great range of components and requirements. However, comprehensive guidelines for the design and deployment of robots in harsh underground environments have not been established. As a result, the developers of coal-mine rescue robots (CMRRs) must exercise their own judgment on the development and evaluation of the platform functionalities. This survey attempts to review design and functionality requirements based on the common practices and lessons learned from the existing CMRRs with the aim of facilitating future research and development on coal-mine search and rescue robots. An updated overview of the documented CMRRs of the last 3 decades showcases the intricate relationship of the common design considerations for CMRR design.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"13 ","pages":"1857704"},"PeriodicalIF":3.7,"publicationDate":"2026-08-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13487453/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148799477","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Combining exploration and imitation in contact-rich task learning on an articulated soft robot arm.","authors":"Laurenz Elstner, Erik Kyrkjebø, Martin F Stoelen","doi":"10.3389/frobt.2026.1885625","DOIUrl":"https://doi.org/10.3389/frobt.2026.1885625","url":null,"abstract":"<p><p>Learning from demonstration (LfD) has become a popular approach with the emergence of modern transformer-based algorithms. However, the performance of these policies is limited by the quality of the demonstrations. Combining imitation and exploration promises to train policies that perform better and are more reliable. However, this requires a robotic system that can explore safely without damaging itself or the environment, especially in contact-rich tasks during which the robot must exert force on its environment to solve the task. In this study, we investigate the combination of a state-of-the-art reinforcement learning (RL) algorithm with human demonstrations to learn how to open a door with minimal task-specific engineering on an articulated soft robot arm. We found that learning from both exploration and demonstration data stored in separate buffers makes the algorithm not only more sample-efficient and robust but also allows the policy to reach a higher performance level than the provided expert demonstrations. We also show that using an articulated soft robotic arm allows us to perform RL on a real robotic system without any pretraining and with a simple safety system that does not require any additional sensors, such as force-torque sensors. Additionally, we can implicitly learn the nonlinearities stemming from the soft materials in the actuator. Our findings show that combining LfD with RL results in both better performance and more robust behaviors and indicate that articulated soft robots allow for learning contact-rich tasks safely on a real system.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"13 ","pages":"1885625"},"PeriodicalIF":3.7,"publicationDate":"2026-08-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13485553/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148799686","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Predictive fatigue-aware human-robot collaboration: a real-time, open-source ROS 2 instantiation of a three-module human-centric digital twin framework on a standard cobot.","authors":"Ranidu P Goonetilleke, Azfar Khalid","doi":"10.3389/frobt.2026.1897261","DOIUrl":"10.3389/frobt.2026.1897261","url":null,"abstract":"<p><p>Industry 5.0 cobotics calls for collaborative robots that adapt to the operator's physical and cognitive state in real time. Most current industrial deployments remain reactive, responding only after explicit commands and ignoring the operator's psychophysiological condition. The three-module Human-Centric Digital Twin (HCDT) framework establishes the upstream perception-and-reasoning architecture for such systems using Vision-Language Models, and identifies closed-loop feedback and physical-assistance mechanisms as the natural next layer in the framework's development. Building on that foundation, this paper presents a complementary, real-time instantiation specialised for the resource-constrained, vision-plus-biosignal setting typical of ergonomics-and-safety HRC, deployed on a standard collaborative robot (Universal Robots UR3 with a Robotiq 2F-85 gripper) and extended with closed-loop operator-state adaptation. The Perception module pairs MediaPipe hand-landmark tracking and a Random Forest gesture classifier with Tobii Pro Glasses 3 pupillometry. The Reasoning module combines a ten-state finite-state machine, a weighted composite fatigue score (blink rate, blink duration, PERCLOS, hand-jerk) banded into FRESH, MILD, MODERATE and SEVERE, a saccade-gated commitment fixation, and a Task-Evoked Pupillary Response (TEPR) detector for acute-stress soft-emergency-stop. The Motion module provides a closed-form analytical inverse-kinematics solver, workspace clamping and a slew-rate-limited joint-velocity controller. Velocity-based linear extrapolation of hand position over a 0.5 s horizon enables anticipatory robot pre-positioning. The system is presented as a single-operator feasibility study rather than a generalisation claim. On a leak-free split-then-augment evaluation (520 raw test samples not seen by the training fold in any orientation), the Random Forest classifier reaches 99.62% accuracy with both errors falling in the Okay-Neutral confusion pair that the geometric override layer is designed to catch; a comparison against MLP and KNN baselines on the same split shows all three classifiers within the real-time control budget. Saccade-gated early-commit is designed to recover the modelled 150-300 ms gaze-to-motion lead, and the TEPR Soft E-Stop operates on an independent 300-500 ms channel. End-to-end gesture-to-motion latency has a conservative worst-case ceiling of approximately 830 ms, formed by a camera-buffer term, the 10-frame debounce and one control tick, inside the 1-s interactive response-time limit adopted as the design target. Owing to a Tobii Pro Glasses 3 hardware fault, the physiological pathways (fatigue banding, TEPR soft-stop and gaze commitment) were verified through their downstream control responses to simulated triggers rather than validated on organic pupil data; organic, multi-participant validation is identified as future work.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"13 ","pages":"1897261"},"PeriodicalIF":3.7,"publicationDate":"2026-08-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13481234/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148799461","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Suraj Borate, Bhavish Rai B, Vipul Pardeshi, Madhu Vadali
{"title":"CoMuRoS - An LLM-based generalizable hierarchical task planning and execution framework for heterogeneous robot teams with event-driven re-planning.","authors":"Suraj Borate, Bhavish Rai B, Vipul Pardeshi, Madhu Vadali","doi":"10.3389/frobt.2026.1843313","DOIUrl":"https://doi.org/10.3389/frobt.2026.1843313","url":null,"abstract":"<p><p>Heterogeneous multi-robot teams require systems that can interpret natural-language goals, allocate tasks, and adapt to unexpected events. We developed CoMuRoS (Collaborative Multi-Robot System), a generalizable hierarchical architecture combining a centralized task-manager LLM with decentralized robot-level LLMs for executable Python generation from primitive ROS2 skills. The task manager uses static planning rules and dynamic context, including task history, robot/task status, and detected events, while onboard perception using VLM/image processing classifies events as relevant or irrelevant and triggers replanning. Hardware experiments demonstrated recovery from disruptive events, filtering of irrelevant distractions, and coordinated transport with emergent human-robot cooperation, achieving success rates of 9/10 for collaborative object recovery, 8/8 for coordinated transport, and 5/5 for human-assisted recovery. Simulation studies demonstrated intention-aware replanning. A curated benchmark of 22 scenarios, 54 tasks, and around 20 robots evaluated task allocation, classification, IoU, executability, and correctness across multiple LLMs, with correctness up to 0.91 ± 0.053; a 20-scenario replanning benchmark achieved Correctness = 0.948 ± 0.034 using Grok 3. CoMuRoS enables runtime, event-driven replanning on physical robots and supports flexible multi-robot and human-robot collaboration across diverse scenarios.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"13 ","pages":"1843313"},"PeriodicalIF":3.7,"publicationDate":"2026-08-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13482247/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148799675","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Juan Diego Peña-Narvaez, Rodrigo Pérez-Rodríguez, Esther Aguado, Francisco Miguel Moreno, Francisco Martín Rico
{"title":"Predictive vision-language monitoring for proactive safety in robot task execution.","authors":"Juan Diego Peña-Narvaez, Rodrigo Pérez-Rodríguez, Esther Aguado, Francisco Miguel Moreno, Francisco Martín Rico","doi":"10.3389/frobt.2026.1870024","DOIUrl":"https://doi.org/10.3389/frobt.2026.1870024","url":null,"abstract":"<p><p>Robots that execute language-conditioned tasks in dynamic environments often rely on feedback only after an action has failed, which can be insufficient when failures involve collisions or workspace conflicts. This paper presents a predictive monitoring framework that uses Vision-Language Models (VLMs) to assess near-future execution risk during robot task execution. The framework first generates structured plans with action execution conditions and a plan-level fallback action. During execution, a monitoring module combines visual observations, the current action, and the relevant execution conditions to estimate whether a condition is likely to be violated within a short future time window. When the predicted risk exceeds a task-specific threshold, the robot halts the current action, executes the fallback behavior, and replans from the updated state. We evaluate the approach in Gazebo simulation on mobile navigation with a moving human obstacle and manipulation with two robot arms sharing a workspace. Across controlled collision-risk settings, the proposed method achieves higher task success rates than reactive VLM-based baselines while requiring fewer replanning events than conservative current-state precondition checking. The results indicate that predictive vision-language monitoring can improve task completion in simulated dynamic robot tasks, while remaining subject to limitations such as VLM latency, prompt sensitivity, and evaluation beyond simulation.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"13 ","pages":"1870024"},"PeriodicalIF":3.7,"publicationDate":"2026-08-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13477910/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148799519","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Explainable AI analysis of brake control in CARLA through reference and distilled policies.","authors":"Chenghao Wang, Lingyun Ke, Xiaoming Liu, Danni Huang, Jingyu Yao, Weishen Chu","doi":"10.3389/frobt.2026.1847808","DOIUrl":"https://doi.org/10.3389/frobt.2026.1847808","url":null,"abstract":"<p><p>This paper presents an explainable AI analysis of brake control in CARLA closed-loop driving. Longitudinal braking is studied through a threshold policy, a risk-aware reference policy, and a distilled policy learned from reference rollouts. The framework combines structured traffic-state features, high-fidelity XGBoost surrogates, and SHAP to analyze deployed brake behavior across Town10HD and Town05. Results show that brake generation is consistently dominated by front-vehicle distance, relative speed, and time to collision, while lateral variables contribute weakly. The distilled controller retains a forward-risk-oriented explanation structure rather than behaving as an arbitrary black box, but the degree of apparent semantic alignment with the reference policy is environment-dependent. Fallback-aware analysis shows that this alignment is substantially reinforced by the deployed safety fallback in Town10HD, while Town05 provides a cleaner view of the learned component itself. These findings show that learned brake control can remain interpretable when grounded in semantically structured state representations.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"13 ","pages":"1847808"},"PeriodicalIF":3.7,"publicationDate":"2026-08-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13477971/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148799702","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Joseph R Tolone, Trevor W Harrison, Zoltan B Szuts, Derek A Paley
{"title":"Adaptive sampling in the Philippine Sea using autonomous profiling floats and FloatCast.","authors":"Joseph R Tolone, Trevor W Harrison, Zoltan B Szuts, Derek A Paley","doi":"10.3389/frobt.2026.1813102","DOIUrl":"https://doi.org/10.3389/frobt.2026.1813102","url":null,"abstract":"<p><p>This work details a method for manipulating the horizontal position of free-drifting ocean-profiling floats using vertical depth control. Profiling floats are often used to study oceanographic processes of varying spatial and temporal scales. Since deploying floats is logistically demanding and expensive, active floats must collect measurements most relevant to the sampling objectives. To that end, we present the FloatCast framework for managing drift in a fleet of floats via vertical depth control. The FloatCast software selects float dive commands that are anticipated to align best with sampling objectives by combining tools from machine learning, optimization, and feedback control. First, an echo state network is used to generate forecasts of ocean surface flow. These forecasts are used to compute float trajectory predictions for each set of candidate dive commands. The performance of each set of dive commands is then ranked using a mapping error scoring metric, and the highest-ranking command set is provided to the floats for their next dive. Reported here are simulation and real-time experimental results from FloatCast control in the Philippine Sea. The simulation results provide insight into the broader FloatCast methodology; experimental results show that this control framework has promise, though it offers no performance guarantees. Although these floats are inherently underactuated, implementing FloatCast can increase the sampling effectiveness of a float array and, in turn, improve scientific data products.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"13 ","pages":"1813102"},"PeriodicalIF":3.7,"publicationDate":"2026-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13473917/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148761092","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Feedback modalities in human-cobot collaboration: experimental evaluation of performance, user experience, and physiological responses.","authors":"Amir Biton, Yuval Cohen, Shraga Shoval","doi":"10.3389/frobt.2026.1836165","DOIUrl":"https://doi.org/10.3389/frobt.2026.1836165","url":null,"abstract":"<p><p>Collaborative robots (cobots) are increasingly deployed in industrial as well as non-industrial domains to support human-centered operation. While physical safety and task efficiency have received considerable attention, less is known about how feedback modality influences operator experience and physiological responses under different collaboration demands. This study examines the effects of feedback modalities in two human-cobot collaboration scenarios representing distinct coordination structures: a low-collaboration turn-taking task and a high-collaboration synchronous shared-control task. Across these scenarios, auditory, visual, and combined auditory-visual feedback modalities were evaluated, and an additional projected assistive interface (PAI) condition, designed specifically for the given scenario, was introduced in the high-collaboration task. Outcomes included task completion time, subjective user assessments of interaction quality and comfort, and physiological responses based on heart rate variability (HRV) indicators reflecting autonomic activity. The results indicate that feedback modality significantly influences performance, subjective experience, and physiological activation within each collaboration scenario. In the low-collaboration task, the no-feedback condition yielded the shortest completion times but was associated with lower perceived interaction quality and descriptively higher autonomic activation. In contrast, multimodal feedback improved perceived comfort and task understanding while slightly increasing completion time. In the high-collaboration task, the examined PAI guidance condition was associated with the shortest task completion times and the highest subjective ratings, while also being accompanied by increased sympathetic-dominant physiological activation. These findings indicate a design trade-off in which richer guidance can enhance coordination efficiency but may be associated with increased cognitive and physiological demands. Importantly, the results suggest that physiological activation should be interpreted in relation to task demands and performance outcomes, rather than as a direct indicator of detrimental stress. More broadly, the study suggests that collaboration configuration and feedback modality should be co-designed as interdependent parameters within the specific coordination demands of collaborative human-robot interaction tasks. Although the PAI was designed for this specific scenario, future research may examine whether similarly tailored interfaces can support positive user evaluations in other complex collaborative tasks. By integrating subjective and physiological measures, this work provides evidence-informed guidance for designing feedback strategies that support efficient, safe, and sustainable human-cobot collaboration.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"13 ","pages":"1836165"},"PeriodicalIF":3.7,"publicationDate":"2026-07-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13467822/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148761833","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Object-grounded embodied picking for e-commerce warehouse fulfillment: a foveated diffusion policy for operational robustness.","authors":"Chaoqun Li, Longfei Wang, Huiying Xu, Xiaolei Zhang, Zhenglong Wan, Xinzhong Zhu","doi":"10.3389/frobt.2026.1883320","DOIUrl":"https://doi.org/10.3389/frobt.2026.1883320","url":null,"abstract":"<p><p>Embodied picking for e-commerce fulfillment remains vulnerable to dense clutter, reflective packaging, and background variation, which can undermine the effectiveness and robustness of visuomotor policies learned from demonstrations. A key limitation is the absence of explicit object grounding, causing policies to exploit spurious contextual cues rather than task-relevant visual evidence. To address this issue, we propose the Foveated Diffusion Policy (FDP), which integrates object-centric visual grounding into diffusion-based action generation. FDP adopts a panorama-fovea dual-stream visual encoder: a low-resolution panorama stream captures global scene context, while a detection-guided fovea stream uses ROI Align to extract high-resolution object tokens. At each denoising step, these tokens are incorporated into the diffusion denoiser through object-guided cross-attention, thereby grounding action generation in target-specific visual evidence instead of undifferentiated global representations. We evaluate FDP on ten benchmark datasets spanning six simulated manipulation tasks with both proficient-human and multi-human demonstrations. FDP achieves average success rates of 81.0% and 76.8%, respectively, outperforming diffusion-based baselines and delivering particularly strong performance on object-centric tasks, including Push-T (86.7 ± 2.5%) and Lift (100.0 ± 0.0%). Ablation studies on a diagnostic subset show that foveated conditioning improves the average success rate by 11.3 percentage points over the non-foveated variant. FDP also maintains an 84.0% success rate under severe localization perturbations (σ = 10 pixels), demonstrating resilience to detection noise. Furthermore, accelerated DDIM sampling reduces policy-inference latency to approximately 55 ms with 10 denoising steps, supporting the feasibility of closed-loop control. Collectively, these results demonstrate that explicit object grounding is a promising and computationally practical approach to improving the robustness of visuomotor policies in warehouse-relevant simulated manipulation scenarios.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"13 ","pages":"1883320"},"PeriodicalIF":3.7,"publicationDate":"2026-07-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13467829/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148759916","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}