Menaldi, J. L.; Robin, M. On some impulse control problems with constraint. (English) Zbl 1381.49037 SIAM J. Control Optim. 55, No. 5, 3204-3225 (2017). In this paper, the authors give a comprehensive analysis about an impulse control problem of a discounted-cost type associated to a considerably general Markov-Feller process \(\{x_t\}\) with the key property that impulses are allowed to take place only when a given signal “arrives”. The signal is modeled as a stochastic process \(\{y_t\}\) that does not necessarily satisfy the Markov property and that could be dependent to \(\{x_t\}\) in some sense. Once the process \(\{y_t\}\) is provided, the “arrival” of the signal means either scenarios: (a) \(y_t=0\), or a more restricted case \(y_t=0\) and \(t>0\). Both cases are analyzed in detail.Optimality results are described through the use of the well-known dynamic programming method; in particular, an associated HJB equation is described whose solution is shown to exist in a suitable sense and it coincides with the optimal value of the control problem. Finally, a specific optimal control of feedback-type is supplied based on the use of the so-named continuation region.The paper is well-written and easy to follow. Reviewer: Hector Jasso (México D. F.) Cited in 1 ReviewCited in 15 Documents MSC: 49N25 Impulsive optimal control problems 93E20 Optimal stochastic control 49J40 Variational inequalities 60J60 Diffusion processes 60J75 Jump processes (MSC2010) 49L20 Dynamic programming in optimal control and differential games 49N35 Optimal feedback synthesis 94A12 Signal theory (characterization, reconstruction, filtering, etc.) Keywords:Markov-Feller processes; information constraints; control by interventions PDFBibTeX XMLCite \textit{J. L. Menaldi} and \textit{M. Robin}, SIAM J. Control Optim. 55, No. 5, 3204--3225 (2017; Zbl 1381.49037) Full Text: DOI References: [1] A. Bensoussan, {\it Stochastic Control by Functional Analysis Methods}, North-Holland, Amsterdam, 1982. · Zbl 0474.93002 [2] A. Bensoussan, {\it Dynamic Programming and Inventory Control}, IOS Press, Amsterdam, 2011. · Zbl 1252.90001 [3] A. Bensoussan and J.-L. Lions, {\it Nouvelle formulation de problèmes de contrôle impulsionnel et applications}, C. R. Acad. Sci. Paris, 276 (1973), pp. 1182-1192. · Zbl 0266.49007 [4] A. Bensoussan and J.-L. Lions, {\it Applications des Inéquations Variationnelles en Contrôle Stochastique}, Dunod, Paris, 1978. · Zbl 0411.49002 [5] A. Bensoussan and J.-L. Lions, {\it Contrôle Impulsionnel et Inéquations Quasi-Variationnelles}, Gauthier-Villars, Paris, 1982. · Zbl 0491.93002 [6] M. H. A. Davis, {\it Markov Models and Optimization}, Chapman & Hall, London, 1993. · Zbl 0780.60002 [7] P. Dupuis and H. Wang, {\it Optimal stopping with random intervention times}, Adv. Appl. Probab., 34 (2002), pp. 141-157. · Zbl 1009.60032 [8] B. Hanouzet and J.L. Joly, {\it Convergence uniforme des itérés définissant la solution d’une inéquation quasi variationnelle abstraite}, C. R. Acad. Sci. Paris Sér. A-B, 286 (1978), pp. A735-A738. · Zbl 0373.49012 [9] O. Hernández-Lerma and J.B. Lasserre, {\it Discrete-time Markov Control Processes}, Springer, New York, 1996. · Zbl 0853.93106 [10] H. Jasso-Fuentes, J.L. Menaldi, and M. Robin, {\it Hybrid Control Models}, manuscript. · Zbl 1386.93309 [11] J. Lempa, {\it Optimal stopping with information constraint}, Appl. Math. Optim., 66 (2012), pp. 147-173. · Zbl 1269.93134 [12] J.P. Lepeltier and B. Marchal, {\it Théorie générale du contrôle impulsionnel markovien}, SIAM J. Control Optim., 22 (1984), pp. 645-665. [13] G. Liang, {\it Stochastic control representations for penalized backward stochastic differential equations}, SIAM J. Control Optim., 53 (2015), pp. 1440-1463. · Zbl 1328.60139 [14] G. Liang and W. Wei, {\it Optimal switching at Poisson random intervention times}, Discrete Contin. Dyn. Syst. Ser. B, to appear. · Zbl 1347.60043 [15] J.L. Menaldi, {\it Optimal impulse control problems for degenerate diffusions with jumps}, Acta Appl. Math., 8 (1987), pp. 165-198. · Zbl 0616.93079 [16] J.L. Menaldi, {\it Stochastic hybrid optimal control models}, in Stochastic Models, II, Guanajuato, 2000, Aportaciones Mat. Investig. 16, Sociadad Matemática Mexicana, México, 2001, pp. 205-250. · Zbl 1032.93080 [17] J.L. Menaldi and M. Robin, {\it On some optimal stopping problems with constraint}, SIAM J. Control Optim., 54 (2016), pp. 2650-2671. · Zbl 1347.60044 [18] J.L. Menaldi and S.S. Sritharan, {\it Impulse control of stochastic Navier-Stokes equations}, Nonlinear Anal., 52 (2003), pp. 357-381. · Zbl 1087.93061 [19] G. Peskir and A. Shiryaev, {\it Optimal Stopping and Free-Boundary Problems}, Birkhäuser, Basel, 2006. · Zbl 1115.60001 [20] M. Robin, {\it Contrôle impulsionnel des processus de Makov}. Thèse d’état, Université Paris Dauphine, Paris, 1978, . [21] R. C. Seydel, {\it Existence and uniqueness of viscosity solutions for QVI associated with impulse control of jump-diffusions}, Stochastic Process. Appl., 119 (2009), pp. 3719-3748. · Zbl 1180.35164 [22] H. Wang, {\it Some control problems with random intervention times}, Adv. Appl. Probab., 33 (2001), pp. 404-422. · Zbl 1012.93067 This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.