Stochastic Modelling and Applied Probability

3 primary works

Stochastic Approximation and Recursive Algorithms and Applications

by Harold Kushner and G George Yin

Published 1 January 2003

This book presents a thorough development of the modern theory of stochastic approximation or recursive stochastic algorithms for both constrained and unconstrained problems. This second edition is a thorough revision, although the main features and structure remain unchanged. It contains many additional applications and results as well as more detailed discussion.

Heavy Traffic Analysis of Controlled Queueing and Communication Networks

by Harold Kushner

Published 17 November 2013

One of the first books in the timely and important area of heavy traffic analysis of controlled and uncontrolled stochastics networks, by one of the leading authors in the field. The general theory is developed, with possibly state dependent parameters, and specialized to many different cases of practical interest.

Hybrid Switching Diffusions

by G George Yin and Chao Zhu

Published 4 October 2009

This book encompasses the study of hybrid switching di usion processes and their applications. The word \hybrid" signi es the coexistence of c- tinuous dynamics and discrete events, which is one of the distinct features of the processes under consideration. Much of the book is concerned with the interactions of the continuous dynamics and the discrete events. Our motivations for studying such processes originate from emerging and - isting applications in wireless communications, signal processing, queueing networks, production planning, biological systems, ecosystems, nancial engineering, and modeling, analysis, and control and optimization of lar- scale systems, under the in uence of random environments. Displaying mixture distributions, switching di usions may be described by the associated operators or by systems of stochastic di erential eq- tions together with the probability transition laws of the switching actions. We either have Markov-modulated switching di usions or processes with continuous state-dependent switching. The latter turns out to be much more challenging to deal with. Viewing the hybrid di usions as a number of di usions joined together by the switching process, they may be se- ingly not much di erent from their di usion counterpart. Nevertheless, the underlying problems become more di cult to handle, especially when the switching processes depend on continuous states. The di culty is due to the interaction of the discrete and continuous processes and the tangled and hybrid information pattern.