zbMATH — the first resource for mathematics

Optimistic value model of indefinite LQ optimal control for discrete-time uncertain systems. (English) Zbl 1391.49066
Summary: Uncertainty theory is a branch of mathematics which provides a new tool to deal with the human uncertainty. Based on uncertainty theory, this paper proposes an optimistic value model of discrete-time linear quadratic (LQ) optimal control, whereas the state and control weighting matrices in the cost function are indefinite, the system dynamics are disturbed by uncertain noises. With the aid of the Bellman’s principle of optimality in dynamic programming, we first present a recurrence equation. Then, a necessary condition for the state feedback control of the indefinite LQ problem is derived by using the recurrence equation. Moreover, a sufficient condition of well-posedness for the indefinite LQ optimal control is given. Finally, a numerical example is presented by using the obtained results.

49N10 Linear-quadratic optimal control problems
93C55 Discrete-time control/observation systems
93C41 Control/observation systems with incomplete information
PDF BibTeX Cite
Full Text: DOI
[1] 1Kalman, R. E., “Contributions to the theory of optimal control,” Bol. Soc. Mat. Mexicana, Vol. 5, No. 2, pp. 102-119 (1960).
[2] 2Wonham, W. M., “On a matrix Riccati equation of stochastic control,” SIAM J. Control Optim., Vol. 6, No. 4, pp. 681-697 (1968).
[3] 3Wang, G., Z. Wu, and J. Xiong, “A linear‐quadratic optimal control problem of forward‐backward stochastic differential equations with partial information,” IEEE Trans. Autom. Control, Vol. 60, No. 11, pp. 2904-2916 (2015). · Zbl 1360.93787
[4] 4Ni, Y. H., X. Li, and J. F. Zhang, “Mean‐field stochastic linear‐quadratic optimal control with Markov jump parameters,” Syst. Control Lett., Vol. 93, pp. 69-76 (2016).
[5] 5Ma, H. and B. Liu, “Linear‐quadratic optimal control problem for partially observed forward‐backward stochastic differential equations of mean‐field type,” Asian J. Control, Vol. 18, No. 6, pp. 2146-2157 (2016). · Zbl 1354.93174
[6] 6Chen, S. P., X. J. Li, and X. Y. Zhou, “Stochastic linear quadratic regulators with indefinite control weight costs,” SIAM J. Control Optim., Vol. 36, No. 5, pp. 1685-1702 (1998). · Zbl 0916.93084
[7] 7Huang, J. and Z. Yu, “Solvability of indefinite stochastic Riccati equations and linear quadratic optimal control problems,” Syst. Control Lett., Vol. 68, No. 1, pp. 68-75 (2014).
[8] 8Qi, J. and W. Zhang, “Discrete‐time indefinite stochastic LQ optimal control: indefinite horizon case,” Acta Autom. Sin., Vol. 35, No. 5, pp. 613-617 (2009).
[9] 9Rami, M. A., X. Chen, and X. Zhou, “Discrete‐time indefinite LQ control with state and control dependent noises,” J. Global Optim., Vol. 23, No. 3, pp. 245-265 (2002). · Zbl 1035.49024
[10] 10Zhou, X. Y. and D. Li, “Continuous‐time mean‐variance portfolio selection: a stochastic LQ framework,” Appl. Math. Optim., Vol. 42, No. 1, pp. 19-33 (2000). · Zbl 0998.91023
[11] 11Zhang, W., L. I. Yan, and X. Liu, “Infinite horizon indefinite stochastic linear quadratic control for discrete‐time systems,” Control Theory Adv. Technol., Vol. 13, No. 3, pp. 230-237 (2015). · Zbl 1340.93177
[12] 12Ferrante, A. and L. Ntogramatzidis, “Continuous‐ time singular linear‐quadratic control: necessary and sufficient conditions for the existence of regular solutions,” Syst. Control Lett., Vol. 93, pp. 30-34 (2016). · Zbl 1336.49040
[13] 13Ferrante, A. and L. Ntogramatzidis, “A note on finite‐horizon LQ problems with indefinite cost,” Automatica, Vol. 52, No. 2, pp. 290-293 (2015). · Zbl 1309.49029
[14] 14Ferrante, A. and L. Ntogramatzidis, “The generalized continuous algebraic Riccati equation and impulse‐free continuous‐time LQ optimal control,” Automatica, Vol. 50, No. 4, pp. 1176-1180 (2014). · Zbl 1421.49030
[15] 15Ferrante, A. and L. Ntogramatzidis, “The generalised discrete algebraic Riccati equation in linear‐quadratic optimal control,” Automatica, Vol. 49, No. 2, pp. 471-478 (2013). · Zbl 1259.49052
[16] 16Rami, M. A. and X. Y. Zhou, “Linear matrix inequalities, Riccati equations, and indefinite stochastic linear quadratic controls,” IEEE Trans. Autom. Control., Vol. 45, No. 6, pp. 1131-1143 (2000). · Zbl 0981.93080
[17] 17Kahneman, D. and A. Tversky, “Prospect theory: an analysis of decision under risk,” Econometrica, Vol. 47, No. 2, pp. 263-291 (1979). · Zbl 0411.90012
[18] 18Liu, B., Uncertainty Theory, 2nd ed., Springer‐ Verlag, Berlin (2007).
[19] 19Liu, B., Uncertainty Theory: a Branch of Mathematics for Modeling Human Uncertainty, Springer‐Verlag, Berlin (2010).
[20] 20Qin, Z., S. Kar, and H. Zheng, “Uncertain portfolio adjusting model using semiabsolute deviation,” Soft Comput., Vol. 20, No. 2, pp. 717-725 (2016). · Zbl 1371.91164
[21] 21Wen, M., Z. Qin, and R. Kang, “The α‐cost minimization model for capacitated facility location‐allocation problem with uncertain demands,” Fuzzy Optim. Decis. Mak., Vol. 13, No. 3, pp. 1-12 (2014).
[22] 22Zhang, B. and J. Peng, “Uncertain programming model for uncertain optimal assignment problem,” Appl. Math. Model., Vol. 37, pp. 6458-6468 (2013). · Zbl 1426.90182
[23] 23Ke, H., T. Su, and Y. Ni, “Uncertain random multilevel programming with application to production control problem,” Soft Comput., Vol. 19, No. 6, pp. 1739-1746 (2015). · Zbl 1364.90236
[24] 24Zhu, Y., “Uncertain optimal control with application to a portfolio selection model,” Cybern. Syst., Vol. 41, No. 7, pp. 535-547 (2010).
[25] 25Yan, H. and Y. Zhu, “Bang‐bang control model for uncertain switched systems,” Appl. Math. Model., Vol. 39, No. 10-11, pp. 2994-3002 (2015).
[26] 26Chen, Y. and Y. Zhu, “Indefinite LQ optimal control with equality constraint for discrete‐time uncertain systems,” Jpn. J. Ind. Appl. Math., Vol. 33, No. 2, pp. 361-378 (2016). · Zbl 1353.49046
[27] 27Shu, Y. and Y. Zhu, “Stability and optimal control for uncertain continuous‐time singular systems,” Eur. J. Control, Vol. 34, pp. 16-23 (2017).
[28] 28Sheng, L. and Y. Zhu, “Optimistic value model of uncertain optimal control,” Int. J. Uncertainty Fuzziness Know.‐Based Syst., Vol. 21, No. 7, pp. 75-87 (2013). · Zbl 1322.93064
[29] 29Li, B., Y. Zhu, and Y. Chen, “The piecewise optimization method for approximating uncertain optimal control problems under optimistic value criterion,” Int. J. Syst. Sci., Vol. 48, No. 8, pp. 1768-1776 (2017).
[30] 30Liu, B., “Some research problems in uncertainy theory,” J. Uncertain Syst., Vol. 3, No. 1, pp. 3-10 (2009).
[31] 31Penrose, R., “A generalized inverse of matrices,” Proc. Camb. Philos. Soc., Vol. 51, pp. 406-413 (1955).
[32] 32Zhu, Y., “Functions of uncertain variables and uncertain programming,” J. Uncertain Syst., Vol. 6, No. 4, pp. 278-288 (2012).
[33] 33Bilardi, G. and A. Ferrante, “The role of terminal cost/reward in finite‐horizon discrete‐time LQ optimal control,” Linear Alg. Appl., Vol. 425, No. 2, pp. 323-344 (2007). · Zbl 1138.49028
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.