×

Technical note – on the optimality of reflection control. (English) Zbl 1457.49037

Summary: The goal of this paper is to illustrate the optimality of reflection control in three different settings, to bring out their connections and to contrast their distinctions. First, we study the control of a Brownian motion with a negative drift, so as to minimize a long-run average cost objective. We prove the optimality of the reflection control, which prevents the Brownian motion from dropping below a certain level by cancelling out from time to time part of the negative drift; and we show that the optimal reflection level can be derived as the fixed point that equates the long-run average cost to the holding cost. Second, we establish the asymptotic optimality of the reflection control when it is applied to a discrete production-inventory system driven by (delayed) renewal processes; and we do so via identifying the limiting regime of the system under diffusion scaling. Third, in the case of controlling a birth-death model, we establish the optimality of the reflection control directly via a linear programming-based approach. In all three cases, we allow an exponentially bounded holding cost function, which appears to be more general than what’s allowed in prior studies. This general cost function reveals some previously unknown technical fine points on the optimality of the reflection control, and extends significantly its domain of applications.

MSC:

49S05 Variational principles of physics
49K45 Optimality conditions for problems involving randomness
92D15 Problems related to evolution
90C05 Linear programming
91B38 Production theory, theory of the firm
91B62 Economic growth models
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Arapostathis A, Borkar VS, Ghosh MK (2012) Ergodic Control of Diffusion Processes (Cambridge University Press, Cambridge, UK).Google Scholar · Zbl 1236.93137
[2] Bensoussan A, Liu RH, Sethi SP (2005) Optimality of an (s, S) policy with compound Poisson and diffusion demands: A quasi-variational inequalities approach. SIAM J. Control Optim. 44(5):1650-1676.Crossref, Google Scholar · Zbl 1151.90304 · doi:10.1137/S0363012904443737
[3] Chen H, Yao DD (2001) Fundamentals of Queueing Networks: Performance, Asymptotics, and Optimization (Springer, New York).Crossref, Google Scholar · Zbl 0992.60003 · doi:10.1007/978-1-4757-5301-1
[4] Dai JG, Yao DC (2013a) Brownian inventory models with convex holding cost—Part 1: Average-optimal controls. Stochastic Systems 3(2):442-499.Link, Google Scholar · Zbl 1295.60096
[5] Dai JG, Yao DC (2013b) Brownian inventory models with convex holding cost—Part 2: Discount-optimal controls. Stochastic Systems 3(2):500-573.Link, Google Scholar · Zbl 1298.60084
[6] Fleming WH, Soner HM (2006) Controlled Markov Processes and Viscosity Solutions, 2nd ed. (Springer, New York).Google Scholar · Zbl 1105.60005
[7] Harrison JM, Taksar MI (1983) Instantaneous control of Brownian motion. Math. Oper. Res. 8(3):439-453.Link, Google Scholar · Zbl 0523.93068
[8] Harrison JM, Sellke TM, Taylor AJ (1983) Impulse control of Brownian motion. Math. Oper. Res. 8(3):454-466.Link, Google Scholar · Zbl 0526.93066
[9] He S, Yao DC, Zhang H (2017) Optimal ordering policy for inventory models with quantity-dependent fixed costs. Math. Oper. Res. 42(4):979-1006.Link, Google Scholar · Zbl 1386.90009
[10] Jacka S, Zervos M (2006) A singular control problem with an expected and a pathwise ergodic performance criterion. J. Appl. Math. Stochastic Anal. 2006:1-19.Crossref, Google Scholar · Zbl 1119.93069 · doi:10.1155/JAMSA/2006/82538
[11] Karatzas I (1983) A class of singular stochastic control problems. Adv. Appl. Probab. 15(2):225-254.Crossref, Google Scholar · Zbl 0511.93076 · doi:10.1017/S0001867800021169
[12] Menaldi JL, Robin M (1984) Some singular control problem with long term average criterion. Thoft-Christensen P, ed. System Modelling and Optimization, Lecture Notes in Control and Information Sciences, vol. 59 (Springer, Berlin), 424-432.Crossref, Google Scholar · Zbl 0548.93079 · doi:10.1007/BFb0008916
[13] Ormeci M, Dai JG, Vande Vate J (2008) Impulse control of Brownian motion: The constrained average cost case. Oper. Res. 56(3):618-629.Link, Google Scholar · Zbl 1167.90349
[14] Protter P (2005) Stochastic Integration and Differential Equations, Stochastic Modeling and Applied Probability, vol. 21, 2nd ed. (Springer, Berlin).Crossref, Google Scholar · doi:10.1007/978-3-662-10061-5
[15] Taksar MI (1985) Average optimal singular control and a related stopping problem. Math. Oper. Res. 10(1):63-81.Link, Google Scholar · Zbl 0562.93083
[16] Weerasinghe A (2002) Stationary stochastic control for Itô processes. Adv. Appl. Probab. 34(1):128-140.Crossref, Google Scholar · Zbl 1020.93028 · doi:10.1239/aap/1019160953
[17] Wu J, Chao X (2014) Optimal control of a Brownian production/inventory system with average cost criterion. Math. Oper. Res. 39(1):163-189.Link, Google Scholar · Zbl 1311.49046
[18] Yao DC, Chao X, Wu J (2015) Optimal control policy for a Brownian inventory system with concave ordering cost. J. Appl. Probab. 52(4):909-925.Crossref, Google Scholar · Zbl 1332.90029 · doi:10.1239/jap/1450802743
[19] Yao DD, · Zbl 0666.93125 · doi:10.1109/9.21110
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.