In this paper we study a bilinear optimal control problem for a diffusive Lotka-Volterra competition model with chemo-repulsion in a bounded domain of ℝ^(ℕ),N=2,3.This model describes the competition of two species in...In this paper we study a bilinear optimal control problem for a diffusive Lotka-Volterra competition model with chemo-repulsion in a bounded domain of ℝ^(ℕ),N=2,3.This model describes the competition of two species in which one of them avoid encounters with rivals through a chemo-repulsion mechanism.We prove the existence and uniqueness of weak-strong solutions,and then we analyze the existence of a global optimal solution for a related bilinear optimal control problem,where the control is acting on the chemical signal.Posteriorly,we derive first-order optimality conditions for local optimal solutions using the Lagrange multipliers theory.Finally,we propose a discrete approximation scheme of the optimality system based on the gradient method,which is validated with some computational experiments.展开更多
We present an optimal and robust quantum control method for efficient population transfer in asymmetric double quantum-dot molecules.We derive a long-duration control scheme that allows for highly efficient population...We present an optimal and robust quantum control method for efficient population transfer in asymmetric double quantum-dot molecules.We derive a long-duration control scheme that allows for highly efficient population transfer by accurately controlling the amplitude of a narrow-bandwidth pulse.To overcome fluctuations in control field parameters,we employ a frequency-domain quantum optimal control theory method to optimize the spectral phase of a single pulse with broad bandwidth while preserving the spectral amplitude.It is shown that this spectral-phase-only optimization approach can successfully identify robust and optimal control fields,leading to efficient population transfer to the target state while concurrently suppressing population transfer to undesired states.The method demonstrates resilience to fluctuations in control field parameters,making it a promising approach for reliable and efficient population transfer in practical applications.展开更多
This paper presents a novel sequential inverse optimal control(SIOC)method for discrete-time systems,which calculates the unknown weight vectors of the cost function in real time using the input and output of an optim...This paper presents a novel sequential inverse optimal control(SIOC)method for discrete-time systems,which calculates the unknown weight vectors of the cost function in real time using the input and output of an optimally controlled discrete-time system.The proposed method overcomes the limitations of previous approaches by eliminating the need for the invertible Jacobian assumption.It calculates the possible-solution spaces and their intersections sequentially until the dimension of the intersection space decreases to one.The remaining one-dimensional vector of the possible-solution space’s intersection represents the SIOC solution.The paper presents clear conditions for convergence and addresses the issue of noisy data by clarifying the conditions for the singular values of the matrices that relate to the possible-solution space.The effectiveness of the proposed method is demonstrated through simulation results.展开更多
In this paper, the matrix Riccati equation is considered. There is no general way for solving the matrix Riccati equation despite the many fields to which it applies. While scalar Riccati equation has been studied tho...In this paper, the matrix Riccati equation is considered. There is no general way for solving the matrix Riccati equation despite the many fields to which it applies. While scalar Riccati equation has been studied thoroughly, matrix Riccati equation of which scalar Riccati equations is a particular case, is much less investigated. This article proposes a change of variable that allows to find explicit solution of the Matrix Riccati equation. We then apply this solution to Optimal Control.展开更多
In this paper,a new optimal adaptive backstepping control approach for nonlinear systems under deception attacks via reinforcement learning is presented in this paper.The existence of nonlinear terms in the studied sy...In this paper,a new optimal adaptive backstepping control approach for nonlinear systems under deception attacks via reinforcement learning is presented in this paper.The existence of nonlinear terms in the studied system makes it very difficult to design the optimal controller using traditional methods.To achieve optimal control,RL algorithm based on critic–actor architecture is considered for the nonlinear system.Due to the significant security risks of network transmission,the system is vulnerable to deception attacks,which can make all the system state unavailable.By using the attacked states to design coordinate transformation,the harm brought by unknown deception attacks has been overcome.The presented control strategy can ensure that all signals in the closed-loop system are semi-globally ultimately bounded.Finally,the simulation experiment is shown to prove the effectiveness of the strategy.展开更多
In this paper, we propose the nonconforming virtual element method (NCVEM) discretization for the pointwise control constraint optimal control problem governed by elliptic equations. Based on the NCVEM approximation o...In this paper, we propose the nonconforming virtual element method (NCVEM) discretization for the pointwise control constraint optimal control problem governed by elliptic equations. Based on the NCVEM approximation of state equation and the variational discretization of control variables, we construct a virtual element discrete scheme. For the state, adjoint state and control variable, we obtain the corresponding prior estimate in H<sup>1</sup> and L<sup>2</sup> norms. Finally, some numerical experiments are carried out to support the theoretical results.展开更多
This paper studies a novel distributed optimization problem that aims to minimize the sum of the non-convex objective functionals of the multi-agent network under privacy protection, which means that the local objecti...This paper studies a novel distributed optimization problem that aims to minimize the sum of the non-convex objective functionals of the multi-agent network under privacy protection, which means that the local objective of each agent is unknown to others. The above problem involves complexity simultaneously in the time and space aspects. Yet existing works about distributed optimization mainly consider privacy protection in the space aspect where the decision variable is a vector with finite dimensions. In contrast, when the time aspect is considered in this paper, the decision variable is a continuous function concerning time. Hence, the minimization of the overall functional belongs to the calculus of variations. Traditional works usually aim to seek the optimal decision function. Due to privacy protection and non-convexity, the Euler-Lagrange equation of the proposed problem is a complicated partial differential equation.Hence, we seek the optimal decision derivative function rather than the decision function. This manner can be regarded as seeking the control input for an optimal control problem, for which we propose a centralized reinforcement learning(RL) framework. In the space aspect, we further present a distributed reinforcement learning framework to deal with the impact of privacy protection. Finally, rigorous theoretical analysis and simulation validate the effectiveness of our framework.展开更多
The time-of-use(TOU)strategy can effectively improve the energy consumption mode of customers,reduce the peak-valley difference of load curve,and optimize the allocation of energy resources.This study presents an Opti...The time-of-use(TOU)strategy can effectively improve the energy consumption mode of customers,reduce the peak-valley difference of load curve,and optimize the allocation of energy resources.This study presents an Optimal guidance mechanism of the flexible load based on strategies of direct load control and time-of-use.First,this study proposes a period partitioning model,which is based on a moving boundary technique with constraint factors,and the Dunn Validity Index(DVI)is used as the objective to solve the period partitioning.Second,a control strategy for the curtailable flexible load is investigated,and a TOU strategy is utilized for further modifying load curve.Third,a price demand response strategy for adjusting transferable load is proposed in this paper.Finally,through the case study analysis of typical daily flexible load curve,the efficiency and correctness of the proposed method and model are validated and proved.展开更多
Reinforcement learning(RL) has roots in dynamic programming and it is called adaptive/approximate dynamic programming(ADP) within the control community. This paper reviews recent developments in ADP along with RL and ...Reinforcement learning(RL) has roots in dynamic programming and it is called adaptive/approximate dynamic programming(ADP) within the control community. This paper reviews recent developments in ADP along with RL and its applications to various advanced control fields. First, the background of the development of ADP is described, emphasizing the significance of regulation and tracking control problems. Some effective offline and online algorithms for ADP/adaptive critic control are displayed, where the main results towards discrete-time systems and continuous-time systems are surveyed, respectively.Then, the research progress on adaptive critic control based on the event-triggered framework and under uncertain environment is discussed, respectively, where event-based design, robust stabilization, and game design are reviewed. Moreover, the extensions of ADP for addressing control problems under complex environment attract enormous attention. The ADP architecture is revisited under the perspective of data-driven and RL frameworks,showing how they promote ADP formulation significantly.Finally, several typical control applications with respect to RL and ADP are summarized, particularly in the fields of wastewater treatment processes and power systems, followed by some general prospects for future research. Overall, the comprehensive survey on ADP and RL for advanced control applications has d emonstrated its remarkable potential within the artificial intelligence era. In addition, it also plays a vital role in promoting environmental protection and industrial intelligence.展开更多
Variable Stiffness Actuation(VSA)is an efficient,safe,and robust actuation technology for bionic robotic joints that have emerged in recent decades.By introducing a variable stiffness elastomer in the actuation system...Variable Stiffness Actuation(VSA)is an efficient,safe,and robust actuation technology for bionic robotic joints that have emerged in recent decades.By introducing a variable stiffness elastomer in the actuation system,the mechanical-electric energy conversion between the motor and the load could be adjusted on-demand,thereby improving the performance of the actuator,such as the peak power reduction,energy saving,bionic actuation,etc.At present,the VSA technology has achieved fruitful research results in designing the actuator mechanism and the stiffness adjustment servo,which has been widely applied in articulated robots,exoskeletons,prostheses,etc.However,how to optimally control the stiffness of VSAs in different application scenarios for better actuator performance is still challenging,where there is still a lack of unified cognition and viewpoints.Therefore,from the perspective of optimal VSA performance,this paper first introduces some typical structural design and servo control techniques of common VSAs and then explains the methods and applications of the Optimal Variable Stiffness Control(OVSC)approaches by theoretically introducing different types of OVSC mathematical models and summarizing OVSC methods with varying optimization goals and application scenarios or cases.In addition,the current research challenges of OVSC methods and possible innovative insights are also presented and discussed in-depth to facilitate the future development of VSA control.展开更多
On the multilingual online social networks of global information sharing,the wanton spread of rumors has an enormous negative impact on people's lives.Thus,it is essential to explore the rumor-spreading rules in m...On the multilingual online social networks of global information sharing,the wanton spread of rumors has an enormous negative impact on people's lives.Thus,it is essential to explore the rumor-spreading rules in multilingual environment and formulate corresponding control strategies to reduce the harm caused by rumor propagation.In this paper,considering the multilingual environment and intervention mechanism in the rumor-spreading process,an improved ignorants–spreaders-1–spreaders-2–removers(I2SR)rumor-spreading model with time delay and the nonlinear incidence is established in heterogeneous networks.Firstly,based on the mean-field equations corresponding to the model,the basic reproduction number is derived to ensure the existence of rumor-spreading equilibrium.Secondly,by applying Lyapunov stability theory and graph theory,the global stability of rumor-spreading equilibrium is analyzed in detail.In particular,aiming at the lowest control cost,the optimal control scheme is designed to optimize the intervention mechanism,and the optimal control conditions are derived using the Pontryagin's minimum principle.Finally,some illustrative examples are provided to verify the effectiveness of the theoretical results.The results show that optimizing the intervention mechanism can effectively reduce the densities of spreaders-1 and spreaders-2 within the expected time,which provides guiding insights for public opinion managers to control rumors.展开更多
Vector control schemes have recently been used to drive linear induction motors(LIM)in high-performance applications.This trend promotes the development of precise and efficient control schemes for individual motors.T...Vector control schemes have recently been used to drive linear induction motors(LIM)in high-performance applications.This trend promotes the development of precise and efficient control schemes for individual motors.This research aims to present a novel framework for speed and thrust force control of LIM using space vector pulse width modulation(SVPWM)inverters.The framework under consideration is developed in four stages.To begin,MATLAB Simulink was used to develop a detailed mathematical and electromechanical dynamicmodel.The research presents a modified SVPWM inverter control scheme.By tuning the proportional-integral(PI)controller with a transfer function,optimized values for the PI controller are derived.All the subsystems mentioned above are integrated to create a robust simulation of the LIM’s precise speed and thrust force control scheme.The reference speed values were chosen to evaluate the performance of the respective system,and the developed system’s response was verified using various data sets.For the low-speed range,a reference value of 10m/s is used,while a reference value of 100 m/s is used for the high-speed range.The speed output response indicates that themotor reached reference speed in amatter of seconds,as the delay time is between 8 and 10 s.The maximum amplitude of thrust achieved is less than 400N,demonstrating the controller’s capability to control a high-speed LIM with minimal thrust ripple.Due to the controlled speed range,the developed system is highly recommended for low-speed and high-speed and heavy-duty traction applications.展开更多
Aimed at infinite horizon optimal control problems of discrete time-varying nonlinear systems,in this paper,a new iterative adaptive dynamic programming algorithm,which is the discrete-time time-varying policy iterati...Aimed at infinite horizon optimal control problems of discrete time-varying nonlinear systems,in this paper,a new iterative adaptive dynamic programming algorithm,which is the discrete-time time-varying policy iteration(DTTV)algorithm,is developed.The iterative control law is designed to update the iterative value function which approximates the index function of optimal performance.The admissibility of the iterative control law is analyzed.The results show that the iterative value function is non-increasingly convergent to the Bellman-equation optimal solution.To implement the algorithm,neural networks are employed and a new implementation structure is established,which avoids solving the generalized Bellman equation in each iteration.Finally,the optimal control laws for torsional pendulum and inverted pendulum systems are obtained by using the DTTV policy iteration algorithm,where the mass and pendulum bar length are permitted to be time-varying parameters.The effectiveness of the developed method is illustrated by numerical results and comparisons.展开更多
We present a mathematical and numerical study for a pointwise optimal control problem governed by a variable-coefficient Riesz-fractional diffusion equation.Due to the impact of the variable diffusivity coefficient,ex...We present a mathematical and numerical study for a pointwise optimal control problem governed by a variable-coefficient Riesz-fractional diffusion equation.Due to the impact of the variable diffusivity coefficient,existing regularity results for their constantcoefficient counterparts do not apply,while the bilinear forms of the state(adjoint)equation may lose the coercivity that is critical in error estimates of the finite element method.We reformulate the state equation as an equivalent constant-coefficient fractional diffusion equation with the addition of a variable-coefficient low-order fractional advection term.First order optimality conditions are accordingly derived and the smoothing properties of the solutions are analyzed by,e.g.,interpolation estimates.The weak coercivity of the resulting bilinear forms are proven via the Garding inequality,based on which we prove the optimal-order convergence estimates of the finite element method for the(adjoint)state variable and the control variable.Numerical experiments substantiate the theoretical predictions.展开更多
This paper presents a finite-time economic model predictive control(MPC)algorithm that can be used for frequency regulation and optimal load dispatch in multi-area power systems.Economic MPC can be used in a power sys...This paper presents a finite-time economic model predictive control(MPC)algorithm that can be used for frequency regulation and optimal load dispatch in multi-area power systems.Economic MPC can be used in a power system to ensure frequency stability,real-time economic optimization,control of the system and optimal load dispatch from it.A generalized terminal penalty term was used,and the finite-time convergence of the system was guaranteed.The effectiveness of the proposed model predictive control algorithm was verified by simulating a power system,which had two areas connected by an AC tie line.The simulation results demonstrated the effectiveness of the algorithm.展开更多
Due to the nonlinearity of the reactor power system, the load tracking situation is closely related to the initial steady-state power and the final steady-state power after the introduction of the state feedback contr...Due to the nonlinearity of the reactor power system, the load tracking situation is closely related to the initial steady-state power and the final steady-state power after the introduction of the state feedback controller. Therefore, when the initial power and the final stable power are determined, the particle swarm optimization algorithm is used to find the optimal controller parameters to minimize the load tracking error. Since there are many combinations of initial stable power and final stable power, it is not possible to find the optimal controller parameters for all combinations, so the neural network is used to take the final stable power and the initial stable power as input, and the optimal controller parameters as the output. This method obtains the optimal state feedback controller switching control method can achieve a very excellent load tracking effect in the case of continuous power change, in the power change time point, the response is fast, in the controller parameter switching time point, the actual power does not fluctuate due to the change of controller parameters. .展开更多
Safety critical control is often trained in a simulated environment to mitigate risk.Subsequent migration of the biased controller requires further adjustments.In this paper,an experience inference human-behavior lear...Safety critical control is often trained in a simulated environment to mitigate risk.Subsequent migration of the biased controller requires further adjustments.In this paper,an experience inference human-behavior learning is proposed to solve the migration problem of optimal controllers applied to real-world nonlinear systems.The approach is inspired in the complementary properties that exhibits the hippocampus,the neocortex,and the striatum learning systems located in the brain.The hippocampus defines a physics informed reference model of the realworld nonlinear system for experience inference and the neocortex is the adaptive dynamic programming(ADP)or reinforcement learning(RL)algorithm that ensures optimal performance of the reference model.This optimal performance is inferred to the real-world nonlinear system by means of an adaptive neocortex/striatum control policy that forces the nonlinear system to behave as the reference model.Stability and convergence of the proposed approach is analyzed using Lyapunov stability theory.Simulation studies are carried out to verify the approach.展开更多
This paper is concerned with a novel integrated multi-step heuristic dynamic programming(MsHDP)algorithm for solving optimal control problems.It is shown that,initialized by the zero cost function,MsHDP can converge t...This paper is concerned with a novel integrated multi-step heuristic dynamic programming(MsHDP)algorithm for solving optimal control problems.It is shown that,initialized by the zero cost function,MsHDP can converge to the optimal solution of the Hamilton-Jacobi-Bellman(HJB)equation.Then,the stability of the system is analyzed using control policies generated by MsHDP.Also,a general stability criterion is designed to determine the admissibility of the current control policy.That is,the criterion is applicable not only to traditional value iteration and policy iteration but also to MsHDP.Further,based on the convergence and the stability criterion,the integrated MsHDP algorithm using immature control policies is developed to accelerate learning efficiency greatly.Besides,actor-critic is utilized to implement the integrated MsHDP scheme,where neural networks are used to evaluate and improve the iterative policy as the parameter architecture.Finally,two simulation examples are given to demonstrate that the learning effectiveness of the integrated MsHDP scheme surpasses those of other fixed or integrated methods.展开更多
In Intelligent Transportation Systems(ITS),controlling the trafficflow of a region in a city is the major challenge.Particularly,allocation of the traffic-free route to the taxi drivers during peak hours is one of the ch...In Intelligent Transportation Systems(ITS),controlling the trafficflow of a region in a city is the major challenge.Particularly,allocation of the traffic-free route to the taxi drivers during peak hours is one of the challenges to control the trafficflow.So,in this paper,the route between the taxi driver and pickup location or hotspot with the spatial-temporal dependencies is optimized.Initially,the hotspots in a region are clustered using the density-based spatial clustering of applications with noise(DBSCAN)algorithm tofind the hot spots at the peak hours in an urban area.Then,the optimal route is allocated to the taxi driver to pick up the customer in the hotspot.Before allocating the optimal route,each route between the taxi driver and the hot spot is mapped to the number of taxi drivers.Among the map function,the optimal map is selected using the rain opti-mization algorithm(ROA).If more than one map function is obtained as the opti-mal solution,the map between the route and the taxi driver who has done the least number of trips in the day is chosen as thefinal solution This optimal route selec-tion leads to control of the trafficflow at peak hours.Evaluation of the approach depicts that the proposed trafficflow control scheme reduces traveling time,wait-ing time,fuel consumption,and emission.展开更多
In this paper, we discuss virtual element method (VEM) approximation of optimal control problem governed by Brinkman equations with control constraints. Based on the polynomial projections and variational discretizati...In this paper, we discuss virtual element method (VEM) approximation of optimal control problem governed by Brinkman equations with control constraints. Based on the polynomial projections and variational discretization of the control variable, we build up the virtual element discrete scheme of the optimal control problem and derive the discrete first order optimality system. A priori error estimates for the state, adjoint state and control variables in L<sup>2</sup> and H<sup>1</sup> norm are derived. The theoretical findings are illustrated by the numerical experiments.展开更多
基金supported by Vicerrectoría de Investigación y Extensión of Universidad Industrial de Santander,Colombia,project 3704.
文摘In this paper we study a bilinear optimal control problem for a diffusive Lotka-Volterra competition model with chemo-repulsion in a bounded domain of ℝ^(ℕ),N=2,3.This model describes the competition of two species in which one of them avoid encounters with rivals through a chemo-repulsion mechanism.We prove the existence and uniqueness of weak-strong solutions,and then we analyze the existence of a global optimal solution for a related bilinear optimal control problem,where the control is acting on the chemical signal.Posteriorly,we derive first-order optimality conditions for local optimal solutions using the Lagrange multipliers theory.Finally,we propose a discrete approximation scheme of the optimality system based on the gradient method,which is validated with some computational experiments.
基金This work was supported by the National Natural Science Foundations of China(Grant Nos.12275033,61973317,and 12274470)the Natural Science Foundation of Hunan Province for Distinguished Young Scholars(Grant No.2022JJ10070)+1 种基金the Natural Science Foundation of Hunan Province(Grant No.2022JJ30582)the Scientific Research Fund of Hunan Provincial Education Department(Grant No.20A025).
文摘We present an optimal and robust quantum control method for efficient population transfer in asymmetric double quantum-dot molecules.We derive a long-duration control scheme that allows for highly efficient population transfer by accurately controlling the amplitude of a narrow-bandwidth pulse.To overcome fluctuations in control field parameters,we employ a frequency-domain quantum optimal control theory method to optimize the spectral phase of a single pulse with broad bandwidth while preserving the spectral amplitude.It is shown that this spectral-phase-only optimization approach can successfully identify robust and optimal control fields,leading to efficient population transfer to the target state while concurrently suppressing population transfer to undesired states.The method demonstrates resilience to fluctuations in control field parameters,making it a promising approach for reliable and efficient population transfer in practical applications.
文摘This paper presents a novel sequential inverse optimal control(SIOC)method for discrete-time systems,which calculates the unknown weight vectors of the cost function in real time using the input and output of an optimally controlled discrete-time system.The proposed method overcomes the limitations of previous approaches by eliminating the need for the invertible Jacobian assumption.It calculates the possible-solution spaces and their intersections sequentially until the dimension of the intersection space decreases to one.The remaining one-dimensional vector of the possible-solution space’s intersection represents the SIOC solution.The paper presents clear conditions for convergence and addresses the issue of noisy data by clarifying the conditions for the singular values of the matrices that relate to the possible-solution space.The effectiveness of the proposed method is demonstrated through simulation results.
文摘In this paper, the matrix Riccati equation is considered. There is no general way for solving the matrix Riccati equation despite the many fields to which it applies. While scalar Riccati equation has been studied thoroughly, matrix Riccati equation of which scalar Riccati equations is a particular case, is much less investigated. This article proposes a change of variable that allows to find explicit solution of the Matrix Riccati equation. We then apply this solution to Optimal Control.
基金supported in part by the National Key R&D Program of China under Grants 2021YFE0206100in part by the National Natural Science Foundation of China under Grant 62073321+2 种基金in part by National Defense Basic Scientific Research Program JCKY2019203C029in part by the Science and Technology Development Fund,Macao SAR under Grants FDCT-22-009-MISE,0060/2021/A2 and 0015/2020/AMJin part by the financial support from the National Defense Basic Scientific Research Project(JCKY2020130C025).
文摘In this paper,a new optimal adaptive backstepping control approach for nonlinear systems under deception attacks via reinforcement learning is presented in this paper.The existence of nonlinear terms in the studied system makes it very difficult to design the optimal controller using traditional methods.To achieve optimal control,RL algorithm based on critic–actor architecture is considered for the nonlinear system.Due to the significant security risks of network transmission,the system is vulnerable to deception attacks,which can make all the system state unavailable.By using the attacked states to design coordinate transformation,the harm brought by unknown deception attacks has been overcome.The presented control strategy can ensure that all signals in the closed-loop system are semi-globally ultimately bounded.Finally,the simulation experiment is shown to prove the effectiveness of the strategy.
文摘In this paper, we propose the nonconforming virtual element method (NCVEM) discretization for the pointwise control constraint optimal control problem governed by elliptic equations. Based on the NCVEM approximation of state equation and the variational discretization of control variables, we construct a virtual element discrete scheme. For the state, adjoint state and control variable, we obtain the corresponding prior estimate in H<sup>1</sup> and L<sup>2</sup> norms. Finally, some numerical experiments are carried out to support the theoretical results.
基金supported in part by the National Natural Science Foundation of China(NSFC)(61773260)the Ministry of Science and Technology (2018YFB130590)。
文摘This paper studies a novel distributed optimization problem that aims to minimize the sum of the non-convex objective functionals of the multi-agent network under privacy protection, which means that the local objective of each agent is unknown to others. The above problem involves complexity simultaneously in the time and space aspects. Yet existing works about distributed optimization mainly consider privacy protection in the space aspect where the decision variable is a vector with finite dimensions. In contrast, when the time aspect is considered in this paper, the decision variable is a continuous function concerning time. Hence, the minimization of the overall functional belongs to the calculus of variations. Traditional works usually aim to seek the optimal decision function. Due to privacy protection and non-convexity, the Euler-Lagrange equation of the proposed problem is a complicated partial differential equation.Hence, we seek the optimal decision derivative function rather than the decision function. This manner can be regarded as seeking the control input for an optimal control problem, for which we propose a centralized reinforcement learning(RL) framework. In the space aspect, we further present a distributed reinforcement learning framework to deal with the impact of privacy protection. Finally, rigorous theoretical analysis and simulation validate the effectiveness of our framework.
基金supported by open fund of state key laboratory of operation and control of renewable energy&storage systems(China electric power research institute)(No.NYB51202201709).
文摘The time-of-use(TOU)strategy can effectively improve the energy consumption mode of customers,reduce the peak-valley difference of load curve,and optimize the allocation of energy resources.This study presents an Optimal guidance mechanism of the flexible load based on strategies of direct load control and time-of-use.First,this study proposes a period partitioning model,which is based on a moving boundary technique with constraint factors,and the Dunn Validity Index(DVI)is used as the objective to solve the period partitioning.Second,a control strategy for the curtailable flexible load is investigated,and a TOU strategy is utilized for further modifying load curve.Third,a price demand response strategy for adjusting transferable load is proposed in this paper.Finally,through the case study analysis of typical daily flexible load curve,the efficiency and correctness of the proposed method and model are validated and proved.
基金supported in part by the National Natural Science Foundation of China(62222301, 62073085, 62073158, 61890930-5, 62021003)the National Key Research and Development Program of China (2021ZD0112302, 2021ZD0112301, 2018YFC1900800-5)Beijing Natural Science Foundation (JQ19013)。
文摘Reinforcement learning(RL) has roots in dynamic programming and it is called adaptive/approximate dynamic programming(ADP) within the control community. This paper reviews recent developments in ADP along with RL and its applications to various advanced control fields. First, the background of the development of ADP is described, emphasizing the significance of regulation and tracking control problems. Some effective offline and online algorithms for ADP/adaptive critic control are displayed, where the main results towards discrete-time systems and continuous-time systems are surveyed, respectively.Then, the research progress on adaptive critic control based on the event-triggered framework and under uncertain environment is discussed, respectively, where event-based design, robust stabilization, and game design are reviewed. Moreover, the extensions of ADP for addressing control problems under complex environment attract enormous attention. The ADP architecture is revisited under the perspective of data-driven and RL frameworks,showing how they promote ADP formulation significantly.Finally, several typical control applications with respect to RL and ADP are summarized, particularly in the fields of wastewater treatment processes and power systems, followed by some general prospects for future research. Overall, the comprehensive survey on ADP and RL for advanced control applications has d emonstrated its remarkable potential within the artificial intelligence era. In addition, it also plays a vital role in promoting environmental protection and industrial intelligence.
基金National Key Research and Development Program of China[Grant No.2020YFB1313000]National Natural Science Foundation of China[Grant No.62003060,62101086,51975070]+2 种基金China Postdoctoral Science Foundation[2021M693769]Natural Science Foundation of Chongqing,China[Grant No.cstc2021jcyj-bsh0180]Scientific and Technological Research Program of Chongqing Municipal Education Commission[Grant No.KJQN202100648].
文摘Variable Stiffness Actuation(VSA)is an efficient,safe,and robust actuation technology for bionic robotic joints that have emerged in recent decades.By introducing a variable stiffness elastomer in the actuation system,the mechanical-electric energy conversion between the motor and the load could be adjusted on-demand,thereby improving the performance of the actuator,such as the peak power reduction,energy saving,bionic actuation,etc.At present,the VSA technology has achieved fruitful research results in designing the actuator mechanism and the stiffness adjustment servo,which has been widely applied in articulated robots,exoskeletons,prostheses,etc.However,how to optimally control the stiffness of VSAs in different application scenarios for better actuator performance is still challenging,where there is still a lack of unified cognition and viewpoints.Therefore,from the perspective of optimal VSA performance,this paper first introduces some typical structural design and servo control techniques of common VSAs and then explains the methods and applications of the Optimal Variable Stiffness Control(OVSC)approaches by theoretically introducing different types of OVSC mathematical models and summarizing OVSC methods with varying optimization goals and application scenarios or cases.In addition,the current research challenges of OVSC methods and possible innovative insights are also presented and discussed in-depth to facilitate the future development of VSA control.
基金the National Natural Science Foundation of People’s Republic of China(Grant Nos.U1703262 and 62163035)the Special Project for Local Science and Technology Development Guided by the Central Government(Grant No.ZYYD2022A05)Xinjiang Key Laboratory of Applied Mathematics(Grant No.XJDX1401)。
文摘On the multilingual online social networks of global information sharing,the wanton spread of rumors has an enormous negative impact on people's lives.Thus,it is essential to explore the rumor-spreading rules in multilingual environment and formulate corresponding control strategies to reduce the harm caused by rumor propagation.In this paper,considering the multilingual environment and intervention mechanism in the rumor-spreading process,an improved ignorants–spreaders-1–spreaders-2–removers(I2SR)rumor-spreading model with time delay and the nonlinear incidence is established in heterogeneous networks.Firstly,based on the mean-field equations corresponding to the model,the basic reproduction number is derived to ensure the existence of rumor-spreading equilibrium.Secondly,by applying Lyapunov stability theory and graph theory,the global stability of rumor-spreading equilibrium is analyzed in detail.In particular,aiming at the lowest control cost,the optimal control scheme is designed to optimize the intervention mechanism,and the optimal control conditions are derived using the Pontryagin's minimum principle.Finally,some illustrative examples are provided to verify the effectiveness of the theoretical results.The results show that optimizing the intervention mechanism can effectively reduce the densities of spreaders-1 and spreaders-2 within the expected time,which provides guiding insights for public opinion managers to control rumors.
基金The authors extend their appreciation to the Deanship of Scientific Research at King Khalid University for funding this work through Large Groups Project under grant number(RGP.2/111/43).
文摘Vector control schemes have recently been used to drive linear induction motors(LIM)in high-performance applications.This trend promotes the development of precise and efficient control schemes for individual motors.This research aims to present a novel framework for speed and thrust force control of LIM using space vector pulse width modulation(SVPWM)inverters.The framework under consideration is developed in four stages.To begin,MATLAB Simulink was used to develop a detailed mathematical and electromechanical dynamicmodel.The research presents a modified SVPWM inverter control scheme.By tuning the proportional-integral(PI)controller with a transfer function,optimized values for the PI controller are derived.All the subsystems mentioned above are integrated to create a robust simulation of the LIM’s precise speed and thrust force control scheme.The reference speed values were chosen to evaluate the performance of the respective system,and the developed system’s response was verified using various data sets.For the low-speed range,a reference value of 10m/s is used,while a reference value of 100 m/s is used for the high-speed range.The speed output response indicates that themotor reached reference speed in amatter of seconds,as the delay time is between 8 and 10 s.The maximum amplitude of thrust achieved is less than 400N,demonstrating the controller’s capability to control a high-speed LIM with minimal thrust ripple.Due to the controlled speed range,the developed system is highly recommended for low-speed and high-speed and heavy-duty traction applications.
基金supported in part by Fundamental Research Funds for the Central Universities(2022JBZX024)in part by the National Natural Science Foundation of China(61872037,61273167)。
文摘Aimed at infinite horizon optimal control problems of discrete time-varying nonlinear systems,in this paper,a new iterative adaptive dynamic programming algorithm,which is the discrete-time time-varying policy iteration(DTTV)algorithm,is developed.The iterative control law is designed to update the iterative value function which approximates the index function of optimal performance.The admissibility of the iterative control law is analyzed.The results show that the iterative value function is non-increasingly convergent to the Bellman-equation optimal solution.To implement the algorithm,neural networks are employed and a new implementation structure is established,which avoids solving the generalized Bellman equation in each iteration.Finally,the optimal control laws for torsional pendulum and inverted pendulum systems are obtained by using the DTTV policy iteration algorithm,where the mass and pendulum bar length are permitted to be time-varying parameters.The effectiveness of the developed method is illustrated by numerical results and comparisons.
基金supported by the National Natural Science Foundation of China(11971276,12171287)Natural Science Foundation of Shandong Province(ZR2016JL004)+1 种基金supported by the China Postdoctoral Science Foundation(2021TQ0017,2021M700244)International Postdoctoral Exchange Fellowship Program(Talent-Introduction Program)(YJ20210019)。
文摘We present a mathematical and numerical study for a pointwise optimal control problem governed by a variable-coefficient Riesz-fractional diffusion equation.Due to the impact of the variable diffusivity coefficient,existing regularity results for their constantcoefficient counterparts do not apply,while the bilinear forms of the state(adjoint)equation may lose the coercivity that is critical in error estimates of the finite element method.We reformulate the state equation as an equivalent constant-coefficient fractional diffusion equation with the addition of a variable-coefficient low-order fractional advection term.First order optimality conditions are accordingly derived and the smoothing properties of the solutions are analyzed by,e.g.,interpolation estimates.The weak coercivity of the resulting bilinear forms are proven via the Garding inequality,based on which we prove the optimal-order convergence estimates of the finite element method for the(adjoint)state variable and the control variable.Numerical experiments substantiate the theoretical predictions.
基金supported by the National Natural Science Foundation of China(Grant 62103101)the Natural Science Foundation of Jiangsu Province of China(Grant BK20210217)+5 种基金the China Postdoctoral Science Foundation(Grant 2022M710680)the National Natural Science Foundation of China(Grant 62273094)the"Zhishan"Scholars Programs of Southeast Universitythe Fundamental Science(Natural Science)General Program of Jiangsu Higher Education Institutions(No.21KJB470020)the Open Research Fund of Jiangsu Collaborative Innovation Center for Smart Distribution Network,Nanjing Institute of Technology(No.XTCX202102)the Introduced Talents Scientific Research Start-up Fund Project,Nanjing Institute of Technology(No.YKJ202133).
文摘This paper presents a finite-time economic model predictive control(MPC)algorithm that can be used for frequency regulation and optimal load dispatch in multi-area power systems.Economic MPC can be used in a power system to ensure frequency stability,real-time economic optimization,control of the system and optimal load dispatch from it.A generalized terminal penalty term was used,and the finite-time convergence of the system was guaranteed.The effectiveness of the proposed model predictive control algorithm was verified by simulating a power system,which had two areas connected by an AC tie line.The simulation results demonstrated the effectiveness of the algorithm.
文摘Due to the nonlinearity of the reactor power system, the load tracking situation is closely related to the initial steady-state power and the final steady-state power after the introduction of the state feedback controller. Therefore, when the initial power and the final stable power are determined, the particle swarm optimization algorithm is used to find the optimal controller parameters to minimize the load tracking error. Since there are many combinations of initial stable power and final stable power, it is not possible to find the optimal controller parameters for all combinations, so the neural network is used to take the final stable power and the initial stable power as input, and the optimal controller parameters as the output. This method obtains the optimal state feedback controller switching control method can achieve a very excellent load tracking effect in the case of continuous power change, in the power change time point, the response is fast, in the controller parameter switching time point, the actual power does not fluctuate due to the change of controller parameters. .
基金supported by the Royal Academy of Engineering and the Office of the Chie Science Adviser for National Security under the UK Intelligence Community Postdoctoral Research Fellowship programme。
文摘Safety critical control is often trained in a simulated environment to mitigate risk.Subsequent migration of the biased controller requires further adjustments.In this paper,an experience inference human-behavior learning is proposed to solve the migration problem of optimal controllers applied to real-world nonlinear systems.The approach is inspired in the complementary properties that exhibits the hippocampus,the neocortex,and the striatum learning systems located in the brain.The hippocampus defines a physics informed reference model of the realworld nonlinear system for experience inference and the neocortex is the adaptive dynamic programming(ADP)or reinforcement learning(RL)algorithm that ensures optimal performance of the reference model.This optimal performance is inferred to the real-world nonlinear system by means of an adaptive neocortex/striatum control policy that forces the nonlinear system to behave as the reference model.Stability and convergence of the proposed approach is analyzed using Lyapunov stability theory.Simulation studies are carried out to verify the approach.
基金the National Key Research and Development Program of China(2021ZD0112302)the National Natural Science Foundation of China(62222301,61890930-5,62021003)the Beijing Natural Science Foundation(JQ19013).
文摘This paper is concerned with a novel integrated multi-step heuristic dynamic programming(MsHDP)algorithm for solving optimal control problems.It is shown that,initialized by the zero cost function,MsHDP can converge to the optimal solution of the Hamilton-Jacobi-Bellman(HJB)equation.Then,the stability of the system is analyzed using control policies generated by MsHDP.Also,a general stability criterion is designed to determine the admissibility of the current control policy.That is,the criterion is applicable not only to traditional value iteration and policy iteration but also to MsHDP.Further,based on the convergence and the stability criterion,the integrated MsHDP algorithm using immature control policies is developed to accelerate learning efficiency greatly.Besides,actor-critic is utilized to implement the integrated MsHDP scheme,where neural networks are used to evaluate and improve the iterative policy as the parameter architecture.Finally,two simulation examples are given to demonstrate that the learning effectiveness of the integrated MsHDP scheme surpasses those of other fixed or integrated methods.
文摘In Intelligent Transportation Systems(ITS),controlling the trafficflow of a region in a city is the major challenge.Particularly,allocation of the traffic-free route to the taxi drivers during peak hours is one of the challenges to control the trafficflow.So,in this paper,the route between the taxi driver and pickup location or hotspot with the spatial-temporal dependencies is optimized.Initially,the hotspots in a region are clustered using the density-based spatial clustering of applications with noise(DBSCAN)algorithm tofind the hot spots at the peak hours in an urban area.Then,the optimal route is allocated to the taxi driver to pick up the customer in the hotspot.Before allocating the optimal route,each route between the taxi driver and the hot spot is mapped to the number of taxi drivers.Among the map function,the optimal map is selected using the rain opti-mization algorithm(ROA).If more than one map function is obtained as the opti-mal solution,the map between the route and the taxi driver who has done the least number of trips in the day is chosen as thefinal solution This optimal route selec-tion leads to control of the trafficflow at peak hours.Evaluation of the approach depicts that the proposed trafficflow control scheme reduces traveling time,wait-ing time,fuel consumption,and emission.
文摘In this paper, we discuss virtual element method (VEM) approximation of optimal control problem governed by Brinkman equations with control constraints. Based on the polynomial projections and variational discretization of the control variable, we build up the virtual element discrete scheme of the optimal control problem and derive the discrete first order optimality system. A priori error estimates for the state, adjoint state and control variables in L<sup>2</sup> and H<sup>1</sup> norm are derived. The theoretical findings are illustrated by the numerical experiments.
