Approximation of the exit probability of a stable Markov modulated constrained random walk

Download
2020-06-01
Kabran, Fatma Basoglu
Sezer, Ali Devin
Let X be the constrained randomwalk on Z(+)(2) having increments (1, 0), (- 1, 1), (0,- 1) with jump probabilities lambda(M-k), mu(1)(M-k), and mu(2)(M-k) where M is an irreducible aperiodic finite state Markov chain. The process X represents the lengths of two tandem queues with arrival rate lambda(M-k), and service rates mu(1)(M-k), and mu(2)(M-k); the process M represents the random environment within which the system operates. We assume that the average arrival rate with respect to the stationary measure of M is less than the average service rates, i.e., X is assumed stable. Let tau(n) be the first time when the sum of the components of X equals n for the first time. Let Y be the random walk on ZxZ(+) having increments (- 1, 0), (1, 1), (0,- 1) with probabilities lambda(M-k), mu(1)(M-k), and mu(2)(M-k). Supposing that the queues share a joint buffer of size n, p(n) = P(xn(,)m)(tau(n) < tau(0)) is the probability that this buffer overflows during a busy cycle of the system. To the best of our knowledge, the only methods currently available for the approximation of p(n) are classical large deviations analysis giving the exponential decay rate of pn and rare event simulation. Let tau be the first time the components of Y are equal. For x epsilon R-+(2), x(1)+ x(2) < 1, x(1) > 0, and x(n) = left perpendicular nx right perpendicular , we show that P-(n-xn (1),P-xn(2),P-m)(tau < infinity) approximates P(x(n),m)(tau(n) < tau(0)) with exponentially vanishing relative error as n -> infinity. For the analysis we define a characteristic matrix in terms of the jump probabilities of (X, M). The 0-level set of the characteristic polynomial of this matrix defines the characteristic surface; conjugate points on this surface and the associated eigenvectors of the characteristic matrix are used to define (sub/super) harmonic functions which play a fundamental role both in our analysis and the computation/approximation of P-(y,P-m)(tau < infinity).
ANNALS OF OPERATIONS RESEARCH

Suggestions

APPROXIMATION OF EXCESSIVE BACKLOG PROBABILITIES OF TWO TANDEM QUEUES
Sezer, Ali Devin (2018-09-01)
Let X be the constrained random walk on Z(+)(2) having increments (1, 0), (-1, 1), and (0, -1) with respective probabilities A lambda,mu 1, and mu 2 representing the lengths of two tandem queues. We assume that X is stable and mu 1 not equal mu 2. Let tau(n) be the first time when the sum of the components of X equals n. Let Y be the constrained random walk on Z x Z(+) having increments (-1, 0), (1, 1), and (0, -1) with probabilities lambda, mu(1), and mu(2). Let tau be the first time that the components of...
Excessive backlog probabilities of two parallel queues
Unlu, Kamil Demirberk; Sezer, Ali Devin (2020-10-01)
Let X be the constrained random walk on Z2 + with increments (1, 0), (-1, 0), (0, 1) and (0,-1); X represents, at arrivals and service completions, the lengths of two queues (or two stacks in computer science applications) working in parallel whose service and interarrival times are exponentially distributed with arrival rates.i and service rates mu i, i = 1, 2; we assume.i < mu i, i = 1, 2, i.e., X is assumed stable. Without loss of generality we assume.1 =.1/mu 1 similar to.2 =.2/mu 2. Let tn be the first...
A New Combinatorial Identity for Catalan Numbers
Aker, Kursat; Gursoy, Aysin Erkan (2017-10-01)
In this article, we prove a conjecture about the equality of two generating functions described in "From Parking Functions to Gelfand Pairs (Aker, Can 2012)" attached to two sets whose cardinalities are given by Catalan numbers: We establish a combinatorial bijection between the two sets on which the two generating functions were based on.
Finite bisimulations for switched linear systems
Aydın Göl, Ebru; Lazar, Mircea; Belta, Calin (2013-02-04)
In this paper, we consider the problem of constructing a finite bisimulation quotient for a discrete-time switched linear system in a bounded subset of its state space. Given a set of observations over polytopic subsets of the state space and a switched linear system with stable subsystems, the proposed algorithm generates the bisimulation quotient in a finite number of steps with the aid of sublevel sets of a polyhedral Lyapunov function. Starting from a sublevel set that includes the origin in its interio...
Finite Bisimulations for Switched Linear Systems
Aydın Göl, Ebru; Lazar, Mircea; Belta, Calin (2014-12-01)
In this paper, we consider the problem of constructing a finite bisimulation quotient for a discrete-time switched linear system in a bounded subset of its state space. Given a set of observations over polytopic subsets of the state space and a switched linear system with stable subsystems, the proposed algorithm generates the bisimulation quotient in a finite number of steps with the aid of sublevel sets of a polyhedral Lyapunov function. Starting from a sublevel set that includes the origin in its interio...
Citation Formats
F. B. Kabran and A. D. Sezer, “Approximation of the exit probability of a stable Markov modulated constrained random walk,” ANNALS OF OPERATIONS RESEARCH, pp. 0–0, 2020, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/32356.