caa a22 4500 445842326 CHVBK 20180317145348.0 cr unu---uuuuu 170323e20110601xx s 000 0 eng 10.1007/s00245-010-9124-7 doi (NATIONALLICENCE)springer-10.1007/s00245-010-9124-7 Singular Perturbation for the Discounted Continuous Control of Piecewise Deterministic Markov Processes [Elektronische Daten] [O. Costa, F. Dufour] This paper deals with the expected discounted continuous control of piecewise deterministic Markov processes (PDMP's) using a singular perturbation approach for dealing with rapidly oscillating parameters. The state space of the PDMP is written as the product of a finite set and a subset of the Euclidean space ℝn. The discrete part of the state, called the regime, characterizes the mode of operation of the physical system under consideration, and is supposed to have a fast (associated to a small parameter ε>0) and a slow behavior. By using a similar approach as developed in Yin and Zhang (Continuous-Time Markov Chains and Applications: A Singular Perturbation Approach, Applications of Mathematics, vol.37, Springer, New York, 1998, Chaps.1 and3) the idea in this paper is to reduce the number of regimes by considering an averaged model in which the regimes within the same class are aggregated through the quasi-stationary distribution so that the different states in this class are replaced by a single one. The main goal is to show that the value function of the control problem for the system driven by the perturbed Markov chain converges to the value function of this limit control problem as ε goes to zero. This convergence is obtained by, roughly speaking, showing that the infimum and supremum limits of the value functions satisfy two optimality inequalities as ε goes to zero. This enables us to show the result by invoking a uniqueness argument, without needing any kind of Lipschitz continuity condition. Springer Science+Business Media, LLC, 2010 Piecewise-deterministic Markov processes nationallicence Continuous-time nationallicence Infinite discounted expected cost nationallicence Optimal control nationallicence Singular perturbation nationallicence Costa O. Departamento de Engenharia de Telecomunicações e Controle, Escola Politécnica da Universidade de São Paulo, 05508 900, São Paulo, Brazil aut Dufour F. IMB, Institut Mathématiques de Bordeaux, INRIA Bordeaux Sud Ouest, Team: CQFD, Universite Bordeaux I, 351 cours de la Liberation, 33405, Talence Cedex, France aut Applied Mathematics & Optimization Springer-Verlag 63/3(2011-06-01), 357-384 0095-4616 63:3<357 2011 63 245 https://doi.org/10.1007/s00245-010-9124-7 text/html Onlinezugriff via DOI 1 research-article jats NATIONALLICENCE 856 40 https://doi.org/10.1007/s00245-010-9124-7 text/html Onlinezugriff via DOI NATIONALLICENCE 700 1- Costa O. Departamento de Engenharia de Telecomunicações e Controle, Escola Politécnica da Universidade de São Paulo, 05508 900, São Paulo, Brazil aut NATIONALLICENCE 700 1- Dufour F. IMB, Institut Mathématiques de Bordeaux, INRIA Bordeaux Sud Ouest, Team: CQFD, Universite Bordeaux I, 351 cours de la Liberation, 33405, Talence Cedex, France aut NATIONALLICENCE 773 0- Applied Mathematics & Optimization Springer-Verlag 63/3(2011-06-01), 357-384 0095-4616 63:3<357 2011 63 245 Metadata rights reserved Springer special CC-BY-NC licence nationallicence BK010053 XK010053 XK010000 NATIONALLICENCE NATIONALLICENCE NL-springer