{"title":"Resource allocation with local QoS: Flexible loads in the power grid","authors":"Austin R. Coffman, M. Hale, P. Barooah","doi":"10.1109/CCTA41146.2020.9206313","DOIUrl":"https://doi.org/10.1109/CCTA41146.2020.9206313","url":null,"abstract":"Loads that can vary their power consumption without violating their Quality of service (QoS), that is flexible loads, are an invaluable resource for grid operators. Utilizing flexible loads as a resource requires the grid operator to incorporate them into a resource allocation problem. Since flexible loads are often consumers, for concerns of privacy it is desirable for this problem to have a distributed implementation. Technically, this distributed implementation manifests itself as a time varying convex optimization problem constrained by the QoS of each load. In the literature, a time invariant form of this problem without all of the necessary QoS metrics for the flexible loads is often considered. Moving to a more realistic setup introduces additional technical challenges, due to the problems' time-varying nature. In this work, we develop an algorithm to account for the challenges introduced when considering a time varying setup with appropriate QoS metrics.","PeriodicalId":241335,"journal":{"name":"2020 IEEE Conference on Control Technology and Applications (CCTA)","volume":"72 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124632669","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Reinforcement Learning in Deep Structured Teams: Initial Results with Finite and Infinite Valued Features","authors":"Jalal Arabneydi, Masoud Roudneshin, A. Aghdam","doi":"10.1109/CCTA41146.2020.9206397","DOIUrl":"https://doi.org/10.1109/CCTA41146.2020.9206397","url":null,"abstract":"In this paper, we consider Markov chain and linear quadratic models for deep structured teams with discounted and time-average cost functions under two non-classical information structures, namely, deep state sharing and no sharing. In deep structured teams, agents are coupled in dynamics and cost functions through deep state, where deep state refers to a set of orthogonal linear regressions of the states. In this article, we consider a homogeneous linear regression for Markov chain models (i.e., empirical distribution of states) and a few orthonormal linear regressions for linear quadratic models (i.e., weighted average of states). Some planning algorithms are developed for the case when the model is known, and some reinforcement learning algorithms are proposed for the case when the model is not known completely. The convergence of two model-free (reinforcement learning) algorithms, one for Markov chain models and one for linear quadratic models, is established. The results are then applied to a smart grid.","PeriodicalId":241335,"journal":{"name":"2020 IEEE Conference on Control Technology and Applications (CCTA)","volume":"54 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116979716","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Martin Keller, Marcel Neumann, Katharina Eichler, S. Pischinger, D. Abel, Thivaharan Albin
{"title":"Model Predictive Control for an Organic Rankine Cycle System applied to a Heavy-Duty Diesel Engine","authors":"Martin Keller, Marcel Neumann, Katharina Eichler, S. Pischinger, D. Abel, Thivaharan Albin","doi":"10.1109/CCTA41146.2020.9206319","DOIUrl":"https://doi.org/10.1109/CCTA41146.2020.9206319","url":null,"abstract":"Innovative internal combustion engine (ICE) concepts are in the focus of current research to further increase the engine's efficiency and decrease the greenhouse gas emissions. Only one third of the fuel's energy can be converted to mechanical power. The remaining two thirds leave the engine via exhaust gases and the coolant system as losses. Due to the high exergy level of the exhaust gas, a recovery of its energy with the help of a waste heat recovery system is possible. One promising technology for the use in commercial on-road vehicles is the organic Rankine cycle (ORC). The working principle is as follows: A working fluid is fed by a pump to a heat exchanger in which the fluid is vaporized. The vapor is led through an expansion machine converting the fluid's energy into mechanical energy. This paper presents a model predictive control (MPC) concept for a waste heat recovery system based on an ORC system applied to a heavy-duty diesel engine. The reduced-order modeling approach described in this study is based on physical equations. The resulting model is real-time capable and suitable for the use within the MPC scheme. For validation, the control algorithm is implemented on a rapid control prototyping hardware and tested on a heavy-duty diesel engine test bench equipped with the ORC system.","PeriodicalId":241335,"journal":{"name":"2020 IEEE Conference on Control Technology and Applications (CCTA)","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122960009","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Adaptive Estimation of Near-Optimal Electrostatic Force in Micro Energy-Harvesters","authors":"Masoud Roudneshin, K. Sayrafian-Pour, A. Aghdam","doi":"10.1109/CCTA41146.2020.9206354","DOIUrl":"https://doi.org/10.1109/CCTA41146.2020.9206354","url":null,"abstract":"Recent advancements in micro-electronics have led to the development of miniature-sized wearable sensors that can be used for a variety of health monitoring applications. These sensors are typically powered by small batteries which could require frequent recharge. Energy harvesting can reduce the charging frequency of these sensors. Longer operational lifetime can simplify the everyday use of these wearable sensors in many applications. Our objective in this paper is to maximize the output power of a kinetic-based micro energy-harvester. A hybrid machine learning and analytical approach is proposed to adaptively adjust the electrostatic force in a harvester with Coulomb-Force Parametric Generator (CFPG) architecture. The results show considerable improvement in the output power.","PeriodicalId":241335,"journal":{"name":"2020 IEEE Conference on Control Technology and Applications (CCTA)","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126737515","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Martin Kleindienst, Stefan Koch, M. Reichhartinger
{"title":"Model-based Temperature Control of a Continuous Flow Heater for Efficient Processing of Silicon Wafers","authors":"Martin Kleindienst, Stefan Koch, M. Reichhartinger","doi":"10.1109/CCTA41146.2020.9206290","DOIUrl":"https://doi.org/10.1109/CCTA41146.2020.9206290","url":null,"abstract":"This paper proposes a model-based control approach for a liquid flow heater operated within silicon wafer processing tools used in the semiconductor industry. A distributed-parameter model is presented to describe the thermal dynamic behavior of the heater. Adopting the early-lumping approach, an observer-based controller is designed. This controller ensures a vanishing steady-state error in the case of constant input signals and disturbances. The implemented feedback loop relies on an observer-based anti-windup technique. Real-world tests demonstrate the effectiveness and feasibility of the proposed approach.","PeriodicalId":241335,"journal":{"name":"2020 IEEE Conference on Control Technology and Applications (CCTA)","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134009833","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"On IMC-Based PID Tuning Using Gain-Integrator-Delay Dynamics","authors":"Sam Wisotzki, Sarnaduti Brahma, H. Ossareh","doi":"10.1109/CCTA41146.2020.9206375","DOIUrl":"https://doi.org/10.1109/CCTA41146.2020.9206375","url":null,"abstract":"The Internal Model Control (IMC)-based PID tuning using integrator dynamics is an effective technique for tuning the boost pressure control system in a turbocharged gasoline engine, as investigated in a previous work by the authors. In that work, two IMC-based PID tuning approaches were delineated: one that involved a post hoc modification of initial design to achieve a desired closed-loop performance, and another that assigned a desired closed-loop bandwidth exactly. This paper extends the results of that work by introducing a third design approach employing the technique: one that assigns the desired phase margin exactly. Also, the viability of all three approaches for use with more general plants that are less similar to the boost system is investigated through Monte Carlo simulations. Finally, to illustrate their effectiveness in practice, all three design approaches are applied to a DC motor control problem.","PeriodicalId":241335,"journal":{"name":"2020 IEEE Conference on Control Technology and Applications (CCTA)","volume":"88 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131472456","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Data-driven distributed frequency/voltage and power sharing control for islanded microgrids","authors":"Dong-dong Zheng, A. Karimi","doi":"10.1109/CCTA41146.2020.9206255","DOIUrl":"https://doi.org/10.1109/CCTA41146.2020.9206255","url":null,"abstract":"In this paper, a new data-driven distributed control structure for frequency/voltage regulation and active/reactive power sharing of islanded microgrids is proposed. By using a droop-free concept, the proposed method avoids the inherent timescale separation between primary and secondary control, and improves the transient response for microgrids with inductive, resistive or mixed lines. Besides, the proposed control algorithm is fully data-driven and does not rely on the accurate model or physical parameters of the microgrid. Instead, a classical neural network is adopted to learn the unknown system dynamics online, and an adaptive controller is designed based on the learning results, which makes it easy to apply the proposed control scheme to a real MG with unknown model and parameters. The effectiveness of the proposed method is demonstrated via simulations.","PeriodicalId":241335,"journal":{"name":"2020 IEEE Conference on Control Technology and Applications (CCTA)","volume":"112 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131495230","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Reinforcement Learning Control of Power Systems with Unknown Network Model under Ambient and Forced Oscillations","authors":"Sayak Mukherjee, H. Bai, A. Chakrabortty","doi":"10.1109/CCTA41146.2020.9206271","DOIUrl":"https://doi.org/10.1109/CCTA41146.2020.9206271","url":null,"abstract":"We present a model-free optimal control design for electric power systems with unknown transmission network and load models to improve its dynamic performance using techniques from reinforcement learning (RL) and adaptive dynamic programming (ADP). We consider different persistent disturbances in the grid including ambient oscillations resulting from load fluctuations and their effects on exciter voltage regulation loops. We also consider forced oscillation scenarios that frequently occur due to malfunctioning of governor valves. Our proposed RL algorithm recovers the optimal feedback response in spite of all of these disturbances in a completely model-free way using online measurements of the states, inputs, and the disturbances. The design is validated using the IEEE benchmark 39-bus, 10-generator New England power system model perturbed with different ambient and forced oscillations.","PeriodicalId":241335,"journal":{"name":"2020 IEEE Conference on Control Technology and Applications (CCTA)","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129492367","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
S. Mesli-Kesraoui, Olga Goubali, D. Kesraoui, Ibtihal Eloumami, F. Oquendo
{"title":"Formal Verification of the Race Condition Vulnerability in Ladder Programs","authors":"S. Mesli-Kesraoui, Olga Goubali, D. Kesraoui, Ibtihal Eloumami, F. Oquendo","doi":"10.1109/CCTA41146.2020.9206344","DOIUrl":"https://doi.org/10.1109/CCTA41146.2020.9206344","url":null,"abstract":"Ladder diagram is a widely used language for programming PLCs (Programmable Logic Controllers). The presence of a vulnerability in these programs and its exploitation by an attacker can have drastic consequences. The vulnerability of Race Condition is one of the most critical vulnerabilities in Ladder programs. The behavior of Ladder program with Race Condition is unpredictable and potentially dangerous. In this paper, we propose the formal modeling of this vulnerability allowing its detection by model checking. Concretely, our approach consists in translating the Ladder programs into a network of timed automata. The Race Condition vulnerability is then modeled as a CTL (Computational Tree Logic) property and the UPPAAL model checker is applied to verify the presence of Race Condition in those Ladder programs by verifying that CTL property. Contrary to other approaches proposed in the literature, our solution allows the Race Condition detection in all its forms and thus reinforces the robustness of Ladder programs against this type of attack.","PeriodicalId":241335,"journal":{"name":"2020 IEEE Conference on Control Technology and Applications (CCTA)","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130922025","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Interpretation of Kitamori's Partial-Model-Matching Method in a Descriptor-Form Expression","authors":"S. Kawai, N. Hori","doi":"10.1109/CCTA41146.2020.9206292","DOIUrl":"https://doi.org/10.1109/CCTA41146.2020.9206292","url":null,"abstract":"A partial model-matching controller proposed by Kitamori based on the transfer function in denominator-expanded form, is re-formulated into the descriptor form, which consists of exponential, static, and impulsive modes. By considering order changes as shifts in modes, it is shown for I-PD controller case that the resulting controller can accommodate order changes of the plant and controllers.","PeriodicalId":241335,"journal":{"name":"2020 IEEE Conference on Control Technology and Applications (CCTA)","volume":"2476 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131117279","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}