caa a22 4500 386350566 CHVBK 20180307111827.0 cr unu---uuuuu 161130e198904 xx s 000 0 eng 10.1017/S0269964800001121 doi S0269964800001121 pii (NATIONALLICENCE)cambridge-10.1017/S0269964800001121 Sennott Linn I. Department of Mathematics illinois State University Normal, Illinois 61761 Average Cost Semi-Markov Decision Processes and the Control of Queueing Systems [Elektronische Daten] [Linn I. Sennott] Semi-Markov decision processes underlie the control of many queueing systems. In this paper, we deal with infinite state semi-Markov decision processes with nonnegative, unbounded costs and finite action sets. Axioms for the existence of an expected average cost optimal stationary policy are presented. These conditions generalize the work in Sennott [22] for Markov decision processes. Verifiable conditions for the axioms to hold are obtained. The theory is applied to control of the M/G/l queue with variable service parameter, with on-off server, and with batch processing, and to control of the G/M/m queue with variable arrival parameter and customer rejection. It is applied to a timesharing network of queues with a single server and finally to optimal routing of Poisson arrivals to parallel exponential servers. The final section extends the existence result to compact action spaces. Copyright © Cambridge University Press 1989 Probability in the Engineering and Informational Sciences Cambridge University Press 3/2(1989-04), 247-272 0269-9648 3:2<247 1989 3 PES https://doi.org/10.1017/S0269964800001121 text/html Onlinezugriff via DOI 1 research-article jats NATIONALLICENCE 856 40 https://doi.org/10.1017/S0269964800001121 text/html Onlinezugriff via DOI NATIONALLICENCE 100 1- Sennott Linn I. Department of Mathematics illinois State University Normal, Illinois 61761 NATIONALLICENCE 773 0- Probability in the Engineering and Informational Sciences Cambridge University Press 3/2(1989-04), 247-272 0269-9648 3:2<247 1989 3 PES CC0 http://creativecommons.org/publicdomain/zero/1.0 nationallicence BK010053 XK010053 XK010000 NATIONALLICENCE NATIONALLICENCE NL-cambridge