Weighted Stochastic Riccati Equations for Generalization of Linear Optimal Control

التفاصيل البيبلوغرافية
العنوان: Weighted Stochastic Riccati Equations for Generalization of Linear Optimal Control
المؤلفون: Ito, Yuji, Fujimoto, Kenji, Tadokoro, Yukihiro
سنة النشر: 2023
المجموعة: Computer Science
Mathematics
مصطلحات موضوعية: Mathematics - Optimization and Control, Electrical Engineering and Systems Science - Systems and Control
الوصف: This paper presents weighted stochastic Riccati (WSR) equations for designing multiple types of optimal controllers for linear stochastic systems. The stochastic system matrices are independent and identically distributed (i.i.d.) to represent uncertainty and noise in the systems. However, it is difficult to design multiple types of controllers for systems with i.i.d. matrices while the stochasticity can invoke unpredictable control results. A critical limitation of such i.i.d. systems is that Riccati-like algebraic equations cannot be applied to complex controller design. To overcome this limitation, the proposed WSR equations employ a weighted expectation of stochastic algebraic equations. The weighted expectation is calculated using a weight function designed to handle statistical properties of the control policy. Solutions to the WSR equations provide multiple policies depending on the weight function, which contain the deterministic optimal, stochastic optimal, and risk-sensitive linear (RSL) control. This study presents two approaches to solve the WSR equations efficiently: calculating WSR difference equations iteratively and employing Newton's method. Moreover, designing the weight function yields a novel controller termed the robust RSL controller that has both a risk-sensitive policy and robustness to randomness occurring in stochastic control design.
Comment: This paper is submitted to a journal for possible publication. The copyright of this paper may be transferred without notice, after which this version may no longer be accessible
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2308.02077
رقم الأكسشن: edsarx.2308.02077
قاعدة البيانات: arXiv