{"title":"Risk-aware Energy Management of Extended Range Electric Delivery Vehicles with Implicit Quantile Network","authors":"Pengyue Wang, Yan Li, S. Shekhar, W. Northrop","doi":"10.1109/CASE48305.2020.9216797","DOIUrl":"https://doi.org/10.1109/CASE48305.2020.9216797","url":null,"abstract":"Model-free reinforcement learning (RL) algorithms are used to solve sequential decision-making problems under uncertainty. They are data-driven methods and do not require an explicit model of the studied system or environment. Because of this characteristic, they are widely utilized in Intelligent Transportation Systems (ITS), as real-world transportation systems are highly complex and extremely difficult to model. However, in most literature, decisions are made according to the expected long-term return estimated by the RL algorithm, ignoring the underlying risk. In this work, a distributional RL algorithm called implicit quantile network is adapted for the energy management problem of a delivery vehicle. Instead of only estimating the expected long-term return, the full return distribution is estimated implicitly. This is highly beneficial for applications in ITS, as uncertainty and randomness are intrinsic characteristics of transportation systems. In addition, risk-aware strategies are integrated into the algorithm with the risk measure of conditional value at risk. In this study, we demonstrate that by changing a hyperparameter, the trade-off between fuel efficiency and the risk of running out of battery power during a delivery trip can be controlled according to different application scenarios and personal preferences.","PeriodicalId":212181,"journal":{"name":"2020 IEEE 16th International Conference on Automation Science and Engineering (CASE)","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132709873","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Semi-Heuristic Approach for Tracking Buried Subsea Pipelines using Fluxgate Magnetometers","authors":"Vibhav Bharti, David Lane, Sen Wang","doi":"10.1109/CASE48305.2020.9216755","DOIUrl":"https://doi.org/10.1109/CASE48305.2020.9216755","url":null,"abstract":"Integrity assessment of subsea oil and gas transmission lines is crucial for safe and environment-friendly operations. These are usually very expensive without employing Autonomous Underwater Vehicles (AUVs). Buried sections of long pipelines pose a major hurdle in effective pipeline tracking through an AUV. If a pipe track is lost, then the vehicle needs to invest resources to relocate the pipeline. This work presents a heuristic-based method to detect buried pipes using magnetometers followed by a Kalman filter parameterized to optimally localize subsea pipes. Extensive experiments on real and simulated data are conducted to show the reliable performance of this method for tracking buried pipelines.","PeriodicalId":212181,"journal":{"name":"2020 IEEE 16th International Conference on Automation Science and Engineering (CASE)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116721319","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Online Ranking of Physicians with Perishable Resources","authors":"Hanqi Wen, Xin Pan, Jie Song","doi":"10.1109/CASE48305.2020.9216858","DOIUrl":"https://doi.org/10.1109/CASE48305.2020.9216858","url":null,"abstract":"For the online healthcare platform, it is essential to recommend a list of physicians to arrived patients dynamically, in order to satisfy patients’ varied demands, improve the overall matching degree between patients and physicians as well as the resource allocation efficiency, since each physician only has limited registration capacity. In this paper we construct a general model to describe this dynamic ranking problem with patients’ rank-based choice behavior and limited resources. Under the framework of Markov Decision Process(MDP), the dynamic problem can be decomposed into a series of static problems as long as the marginal value of each physician’s registration resource can be approximated. To deal with the problem that at the cold-start stage the platform does not have available data to capture patients rank-based choice behavior specifically, we design a model-free LP-based method which can efficiently approximate the marginal value without requiring patients’ choice models as the input. We conduct a case study based on the data collected from the online healthcare platform to show how to apply this general framework in a real application and verify the capability of our methods.","PeriodicalId":212181,"journal":{"name":"2020 IEEE 16th International Conference on Automation Science and Engineering (CASE)","volume":"112 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114504889","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Model Predictive Control for Target Tracking in 3D with a Downward Facing Camera Equipped Fixed Wing Aerial Vehicle","authors":"Pravin Mali, A. Singh, M. Krishnal, P. Sujit","doi":"10.1109/CASE48305.2020.9216801","DOIUrl":"https://doi.org/10.1109/CASE48305.2020.9216801","url":null,"abstract":"In this paper, we consider the problem of tracking a ground vehicle with a fixed-wing aerial vehicle (FWV) equipped with a downward-facing camera. The complexity of the problem stems from the highly nonlinear kinematics of the FWV and the stall speed constraint. We propose a Model Predictive Control (MPC) approach for this problem that has two main contributions. Firstly, we model the tracking requirement through a novel constraint function that relates FWV’s position and orientation to the field of view of the camera. Secondly, we make a case for reformulating the underlying optimization of the MPC as an unconstrained problem and solving it through the state of the art gradient descent variants like ADAM and RMSProp. Specifically, we show the real-time performance of this optimizer while achieving good tracking performance under various kinematic constraints. We validate our MPC through extensive simulations, specifically highlighting the 3D spiral-like trajectories obtained for the FWV when tracking a slow-moving ground vehicle. We also present a quantitative analysis of the efficacy of the different gradient descent variants.","PeriodicalId":212181,"journal":{"name":"2020 IEEE 16th International Conference on Automation Science and Engineering (CASE)","volume":"71 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132052481","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Lennart Puck, Philipp Keller, Tristan Schnell, C. Plasberg, Atanas Tanev, G. Heppner, A. Rönnau, R. Dillmann
{"title":"Distributed and Synchronized Setup towards Real-Time Robotic Control using ROS2 on Linux","authors":"Lennart Puck, Philipp Keller, Tristan Schnell, C. Plasberg, Atanas Tanev, G. Heppner, A. Rönnau, R. Dillmann","doi":"10.1109/CASE48305.2020.9217010","DOIUrl":"https://doi.org/10.1109/CASE48305.2020.9217010","url":null,"abstract":"A monolithic black-box controller made by the individual robotic manufacturers commonly controls modern industrial robots. The setup’s single components are not accessible nor exchangeable, often due to them being specially tuned and adjusted to fulfill the demanding requirements for robotic control. The open-source framework ROS enables to combine these monolithic controllers with simple interfaces, therefore allowing more complex robotic applications. The next generation, ROS2, targets highly modular systems of sensors, actuators and controllers, each being interchangeable and further providing real-time capabilities by employing DDS as middleware. This study uses system inherent tools alongside non-invasive measurements for comprehensive insights, thereby guiding to ROS2 applications on an underlying distributed and synchronized real-time Linux system.","PeriodicalId":212181,"journal":{"name":"2020 IEEE 16th International Conference on Automation Science and Engineering (CASE)","volume":"46 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128212624","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yahav Avigal, Jensen Gao, William Wong, Kevin Li, G. Pierroz, F. Deng, M. Theis, Mark Presten, Ken Goldberg
{"title":"Simulating Polyculture Farming to Tune Automation Policies for Plant Diversity and Precision Irrigation","authors":"Yahav Avigal, Jensen Gao, William Wong, Kevin Li, G. Pierroz, F. Deng, M. Theis, Mark Presten, Ken Goldberg","doi":"10.1109/CASE48305.2020.9216984","DOIUrl":"https://doi.org/10.1109/CASE48305.2020.9216984","url":null,"abstract":"Polyculture farming, where multiple crop species are grown simultaneously, has potential to reduce pesticide and water usage, while improving the utilization of soil nutrients. However, it is much harder to automate than monoculture. As a first step toward developing automation control policies for polyculture farming, we present AlphaGardenSim, a fast, first order, open-access simulator that integrates single plant growth models with inter-plant dynamics, including light and water competition between plants in close proximity. The simulator approximates growth in a real greenhouse garden at 9, 000X the speed of natural growth, allowing for policy parameter tuning. We present an analytic automation policy that in simulation reduced water use and achieved high coverage and plant diversity compared with other policies, even in the presence of invasive species. Code and supplementary material can be found at https://github.com/BerkeleyAutomation/AlphaGarden.","PeriodicalId":212181,"journal":{"name":"2020 IEEE 16th International Conference on Automation Science and Engineering (CASE)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128309350","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
R. Zhao, Y. Wan, Qiong Liu, Daheng Dong, Cuiling Li
{"title":"Crowd stability analysis based on fluid resonance superposition principle and Lyapunov criterion","authors":"R. Zhao, Y. Wan, Qiong Liu, Daheng Dong, Cuiling Li","doi":"10.1109/CASE48305.2020.9216957","DOIUrl":"https://doi.org/10.1109/CASE48305.2020.9216957","url":null,"abstract":"It is significant to analyze the stability of a crowd in public places to avoid possible confusion and dangerous accidents. This paper introduces fluid wave theory and regards the crowded groups as continuous media. Crowd panic propagation can be mapped into the spreading of fluid waves. In the case of emergencies, individual pedestrian’s emotion values are calculated by the panic propagation model. Based on the resonance and superposition principles of waves, this study converts emotion value into individual internal frequency. Considering the interaction between individuals, trust coefficient is defined to express the external equivalent frequency. Whether resonance occurs, with amplitude of negative emotion being amplified, can be judged through comparing the pedestrian internal frequency and the external equivalent frequency. In addition, Lyapunov criterion is applied to analyze the crowd stability from a system perspective. The flow chart of algorithm steps and implementation process are designed to realize application of wave superposition and resonance in crowd Stability. This study can further provide a more feasible program to observe the crowd in real time as well as guide evacuation decisions.","PeriodicalId":212181,"journal":{"name":"2020 IEEE 16th International Conference on Automation Science and Engineering (CASE)","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133499421","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Shiguang Wu, Z. Pu, J. Yi, Jinlin Sun, Tianyi Xiong, Tenghai Qiu
{"title":"Adaptive Flocking of Multi-Agent Systems with Uncertain Nonlinear Dynamics and Unknown Disturbances Using Neural Networks*","authors":"Shiguang Wu, Z. Pu, J. Yi, Jinlin Sun, Tianyi Xiong, Tenghai Qiu","doi":"10.1109/CASE48305.2020.9216754","DOIUrl":"https://doi.org/10.1109/CASE48305.2020.9216754","url":null,"abstract":"Collective behavior of multi-agent systems brings some new problems in control theory and application. Especially, flocking problem of multi-agent systems with uncertain nonlinear dynamics and unknown external disturbances is a challenging problem. Some existing works assume that the intrinsic nonlinear dynamics of virtual leader is the same as those of the agents, which is unreasonable and impractical. To solve this issue, we consider an adaptive flocking problem of multi-agent systems with uncertain nonlinear dynamics and unknown external disturbances in this paper, where the intrinsic nonlinear dynamics of virtual leader is allowed to be different from the agents. Firstly, to approximate the uncertain nonlinear dynamics of each agent, an adaptive neural network is used, whose weights are updated online. Furthermore, an adaptive robust signal is designed to counteract the unknown external disturbances and neural network approximation errors, which is independent with the upper bound of the unknown external disturbances and neural network approximation errors. Moreover, an adaptive flocking control law is designed, which is proved that the flocking can be realized and the velocity errors converge to a small neighbor of the origin based on Lyapunov stability theory. Finally, the robustness and superiority of the proposed robust adaptive flocking control law are validated by two representative simulations.","PeriodicalId":212181,"journal":{"name":"2020 IEEE 16th International Conference on Automation Science and Engineering (CASE)","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125864740","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Energy-Aware Multi-Goal Motion Planning Guided by Monte Carlo Search","authors":"Yazz Warsame, S. Edelkamp, E. Plaku","doi":"10.1109/CASE48305.2020.9217008","DOIUrl":"https://doi.org/10.1109/CASE48305.2020.9217008","url":null,"abstract":"Autonomous robots need a reliable way to preserve their energy level while performing a persistent task such as inspection or surveillance. Toward this objective, this paper considers the multi-goal motion-planning problem with multiple recharging stations where a robot operating in a complex environment has to reach each goal while reducing the travel distance and the number of times it recharges. This paper develops an integrated approach that couples samplingbased motion planning with Monte-Carlo Tree Search (MCTS). The proposed MCTS searches over a discrete abstraction, which is obtained via a probabilistic roadmap, and uses a reward function to calculate when, where, and whether it is beneficial to recharge. This results in short tours that also reduce the number of recharges. Such tours are used to guide sampling-based motion planning as it expands a tree of collision-free and dynamically-feasible motions. Experiments with nonlinear dynamical robot models operating in obstaclerich environments demonstrate the efficiency of the approach.","PeriodicalId":212181,"journal":{"name":"2020 IEEE 16th International Conference on Automation Science and Engineering (CASE)","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123874553","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Robotic Harvesting of Asparagus using Machine Learning and Time-of-Flight Imaging – Overview of Development and Field Trials","authors":"M. Peebles, J. Barnett, M. Duke, S. Lim","doi":"10.1109/CASE48305.2020.9217006","DOIUrl":"https://doi.org/10.1109/CASE48305.2020.9217006","url":null,"abstract":"Asparagus is a problematic crop because it grows so quickly that it requires harvesting every one or two days. Asparagus farms require typically 8 workers per hectare for harvesting during peak season. The subsequent labor issues this causes, means it is an ideal crop for robotic harvesting. Several prototype robotic machines have been trialed with limited success. This work investigates the combination of Machine Learning and Time-of-Flight cameras to locate the cutting point of the asparagus spear when travelling at a constant speed of 0. 33m/s. A ‘proof of concept’ machine was developed to validate the detection system and demonstrate harvesting with a rudimentary robotic arm and end effector. Field trials showed the arm harvested 92.3– of the targeted spears. However, it was found that multiple arms will be required to be commercially viable.","PeriodicalId":212181,"journal":{"name":"2020 IEEE 16th International Conference on Automation Science and Engineering (CASE)","volume":"68 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121756561","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}