# Semi-Markov Control Processes with Unknown Holding Times Distribution Under an Average Cost Criterion

Semi-Markov Control Processes with Unknown Holding Times Distribution Under an Average Cost... This paper deals with a class of semi-Markov control models with Borel state and control spaces, possibly unbounded costs, and unknown holding times distribution F . Assuming that F does not depend on state-action pairs, we combine suitable methods of statistical estimation of the mean holding time with control procedures to construct an average cost optimal Markovian policy $\hat{\pi}=\{f_{t}\}$ . http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Applied Mathematics and Optimization Springer Journals

# Semi-Markov Control Processes with Unknown Holding Times Distribution Under an Average Cost Criterion

, Volume 61 (3) – Jun 1, 2010
20 pages

/lp/springer_journal/semi-markov-control-processes-with-unknown-holding-times-distribution-yawMy00cG7
Publisher
Springer-Verlag
Subject
Mathematics; Numerical and Computational Physics; Mathematical Methods in Physics; Theoretical, Mathematical and Computational Physics; Systems Theory, Control; Calculus of Variations and Optimal Control; Optimization
ISSN
0095-4616
eISSN
1432-0606
D.O.I.
10.1007/s00245-009-9086-9
Publisher site
See Article on Publisher Site

### Abstract

This paper deals with a class of semi-Markov control models with Borel state and control spaces, possibly unbounded costs, and unknown holding times distribution F . Assuming that F does not depend on state-action pairs, we combine suitable methods of statistical estimation of the mean holding time with control procedures to construct an average cost optimal Markovian policy $\hat{\pi}=\{f_{t}\}$ .

### Journal

Applied Mathematics and OptimizationSpringer Journals

Published: Jun 1, 2010

## You’re reading a free preview. Subscribe to read the entire article.

### DeepDyve is your personal research library

It’s your single place to instantly
discover and read the research
that matters to you.

over 18 million articles from more than
15,000 peer-reviewed journals.

All for just $49/month ### Explore the DeepDyve Library ### Search Query the DeepDyve database, plus search all of PubMed and Google Scholar seamlessly ### Organize Save any article or search result from DeepDyve, PubMed, and Google Scholar... all in one place. ### Access Get unlimited, online access to over 18 million full-text articles from more than 15,000 scientific journals. ### Your journals are on DeepDyve Read from thousands of the leading scholarly journals from SpringerNature, Elsevier, Wiley-Blackwell, Oxford University Press and more. All the latest content is available, no embargo periods. DeepDyve ### Freelancer DeepDyve ### Pro Price FREE$49/month
\$360/year

Save searches from
PubMed

Create lists to

Export lists, citations