Access the full text.
Sign up today, get DeepDyve free for 14 days.
Loading next page...
/lp/springer_journal/an-excursion-theoretic-approach-to-stability-of-discrete-time-0DRNOjzHMG
References (62)
-
Sean Meyn (2007)
Control Techniques for Complex Networks: Workload -
P. Diaconis, D. Freedman (1999)
Iterated Random FunctionsSIAM Rev., 41
-
D. Bertsekas, S. Shreve (2007)
Stochastic optimal control : the discrete time case -
D. Wilkinson (2006)
Stochastic Modelling for Systems Biology -
D. Liberzon (2003)
Switching in Systems and Control, Systems & Control: Foundations & Applications -
Schaft der, J. Schumacher (1999)
An Introduction to Hybrid Dynamical Systems -
A. Lasota, J. Myjak (2002)
On a dimension of measuresBulletin of The Polish Academy of Sciences Mathematics, 50
-
A. Borodin, J. Kleinberg, P. Raghavan, M. Sudan, David Williamson (2001)
Adversarial queuing theoryJ. ACM, 48
-
A. Lasota, M. Mackey (1994)
Chaos, Fractals, and Noise -
R. Douc, G. Fort, É. Moulines, P. Soulier (2004)
Practical drift conditions for subgeometric rates of convergenceAnnals of Applied Probability, 14
-
A. Lasota, J. Myjak (2002)
On a dimension of measuresPol. Acad. Sci. Bull. Math., 50
-
O. Hernández-Lerma, J. Lasserre (1990)
Value iteration and rolling plans for Markov control processes with unbounded rewards29th IEEE Conference on Decision and Control
-
J. Håstad, T. Leighton, B. Rogoff (1996)
Analysis of backoff protocols for multiple access channelsSIAM J. Comput., 25
-
D. Liberzon (2003)
Switching in Systems and Control -
D. Chatterjee, Peter Hokayem, J. Lygeros (2009)
Stochastic Receding Horizon Control With Bounded Control Inputs: A Vector Space ApproachIEEE Transactions on Automatic Control, 56
-
D. Hobson (1998)
Volatility misspecification, option pricing and superreplication via couplingAnnals of Applied Probability, 8
-
D. Chatterjee, E. Cinquemani, Giorgos Chaloulos, J. Lygeros (2008)
STOCHASTIC CONTROL UP TO A HITTING TIME: OPTIMALITY AND ROLLING-HORIZON IMPLEMENTATIONarXiv: Optimization and Control
-
Xiongzhi Chen (2008)
Brownian Motion and Stochastic Calculus -
Y. Kifer (1986)
Ergodic theory of random transformations -
J. Alden, Raymond Smith (1992)
Rolling Horizon Procedures in Nonhomogeneous Markov Decision ProcessesOper. Res., 40
-
E-mail address: chatterjee@control.ee.ethz -
D.J. Wilkinson (2006)
Stochastic Modelling for Systems Biology. Chapman & Hall/CRC Mathematical and Computational Biology Series -
V. Borkar (1991)
Topics in controlled Markov chains -
J. Maciejowski (2002)
Predictive control : with constraints -
E-mail address: soumik@math.washington.edu -
(1971)
and D -
G. Peskir, A.N. Shiryaev (2006)
Optimal Stopping and Free-Boundary Problems. Lectures in Mathematics ETH Zürich -
O. Hernández-Lerma, J. Lasserre (1999)
Further topics on discrete-time Markov control processes -
Zhong-Ping Jiang, E. Sontag, Y. Wang (1999)
Input-to-state stability for discrete-time nonlinear systemsIFAC Proceedings Volumes, 32
-
Mayank Agarwal, E. Cinquemani, D. Chatterjee, J. Lygeros (2009)
On convexity of stochastic optimization problems with constraints2009 European Control Conference (ECC)
-
(2007)
MPC for stochastic systems, Assessment and future directions of nonlinear model predictive control -
Daniel Revuz, M. Yor (1990)
Continuous martingales and Brownian motion -
R. Blossey (2006)
Computational Biology (Chapman & Hall/Crc Mathematical and Computational Biology Series) -
O. Hernández-Lerma, J. Lasserre (1999)
Discrete-time Markov control processes -
A. Piunovskiy (1997)
Optimal Control of Random Sequences in Problems with Constraints -
H. P. (1931)
Annales de l'Institut Henri PoincaréNature, 128
-
(2008)
Fast simulation of the chemical master equation with iterated function systems -
D. Chatterjee, E. Cinquemani, G. Chaloulos, J. Lygeros (2009)
On stochastic control up to a hitting timeProceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference
-
A. Lasota, T. Szarek (2004)
Dimension of measures invariant with respect to the Ważewska partial differential equationJournal of Differential Equations, 196
-
O. Hernández-Lerma, J.B. Lasserre (1996)
Discrete-Time Markov Control Processes: Basic Optimality Criteria -
J. Håstad, F. Leighton, B. Rogoff (1987)
Analysis of backoff protocols for multiple access channelsProceedings of the nineteenth annual ACM symposium on Theory of computing
-
O. Hernández-Lerma, J. Lasserre (1990)
Error bounds for rolling horizon policies in discrete-time Markov control processesIEEE Transactions on Automatic Control, 35
-
Peter Hokayem, E. Cinquemani, D. Chatterjee, F. Ramponi, J. Lygeros (2010)
Stochastic receding horizon control with output feedback and bounded control inputs49th IEEE Conference on Decision and Control (CDC)
-
A. Arapostathis, V. Borkar, E. Fernández-Gaucherand, M. Ghosh, S. Marcus (1993)
Discrete-time controlled Markov processes with average cost criterion: a surveySiam Journal on Control and Optimization, 31
-
Robin Pemantle, J. Rosenthal (1999)
Moment conditions for a sequence with negative drift to be uniformly bounded in LrStochastic Processes and their Applications, 82
-
S. Meyn, R. Tweedie (1992)
Stability of Markovian processes I: criteria for discrete-time ChainsAdvances in Applied Probability, 24
-
Heriot-Watt University (2004)
AN OVERVIEW OF SOME STOCHASTIC STABILITY METHODS -
T. Szarek (2006)
Feller processes on nonlocally compact spacesAnnals of Probability, 34
-
S. Foss, T. Konstantopoulos (2004)
AN OVERVIEW OF SOME STOCHASTIC STABILITY METHODS( Network Design, Control and Optimization)Journal of The Operations Research Society of Japan, 47
-
G. Simons (1973)
Great Expectations: Theory of Optimal StoppingTechnometrics, 15
-
L. Lorenzi, M. Bertoldi (2006)
Analytical Methods for Markov Semigroups -
Ivan Werner (2005)
Contractive Markov SystemsJournal of the London Mathematical Society, 71
-
P. Moerbeke (1973)
On optimal stopping and free boundary problemsArchive for Rational Mechanics and Analysis, 60
-
S. Jarner, R. Tweedie (2001)
Locally contracting iterated functions and stability of Markov chainsJournal of Applied Probability, 38
-
Werner , Contractive Markov systems , Journal of the London Mathematical Society -
M. Barnsley, S. Demko, J. Elton, J. Geronimo (2019)
Erratum Invariant measures for Markov processes arising from iterated function systems with place-dependent probabilities -
T. Jahnke, W. Huisinga (2006)
Solving the chemical master equation for monomolecular reaction systems analyticallyJournal of Mathematical Biology, 54
-
H. Kushner (1971)
Introduction to stochastic control -
W. Fleming (1997)
Book Review: Discrete-time Markov control processes: Basic optimality criteria -
David Anderson, Thomas Kurtz (2008)
PRODUCT-FORM STATIONARY DISTRIBUTIONS FOR DEFICIENCY ZERO CHEMICAL REACTION NETWORKS BY -
S. Meyn, R. Tweedie (1993)
Markov Chains and Stochastic Stability -
O. Costa, M. Fragoso, R. Marques (2004)
Discrete-Time Markov Jump Linear SystemsIEEE Transactions on Automatic Control, 51
- Publisher
- Springer Journals
- Copyright
- Copyright © 2011 by Springer Science+Business Media, LLC
- Subject
- Mathematics; Numerical and Computational Physics; Mathematical Methods in Physics; Theoretical, Mathematical and Computational Physics; Systems Theory, Control; Calculus of Variations and Optimal Control; Optimization
- ISSN
- 0095-4616
- eISSN
- 1432-0606
- DOI
- 10.1007/s00245-010-9117-6
- Publisher site
- See Article on Publisher Site
Abstract
We address stability of a class of Markovian discrete-time stochastic hybrid systems. This class of systems is characterized by the state-space of the system being partitioned into a safe or target set and its exterior, and the dynamics of the system being different in each domain. We give conditions for L 1 -boundedness of Lyapunov functions based on certain negative drift conditions outside the target set, together with some more minor assumptions. We then apply our results to a wide class of randomly switched systems (or iterated function systems), for which we give conditions for global asymptotic stability almost surely and in L 1 . The systems need not be time-homogeneous, and our results apply to certain systems for which functional-analytic or martingale-based estimates are difficult or impossible to get.
Journal
Applied Mathematics and Optimization – Springer Journals
Published: Apr 1, 2011