Show/Hide Menu
Hide/Show Apps
Logout
Türkçe
Türkçe
Search
Search
Login
Login
OpenMETU
OpenMETU
About
About
Open Science Policy
Open Science Policy
Communities & Collections
Communities & Collections
Help
Help
Frequently Asked Questions
Frequently Asked Questions
Guides
Guides
Thesis submission
Thesis submission
MS without thesis term project submission
MS without thesis term project submission
Publication submission with DOI
Publication submission with DOI
Publication submission
Publication submission
Supporting Information
Supporting Information
General Information
General Information
Copyright, Embargo and License
Copyright, Embargo and License
Contact us
Contact us
A decomposition approach for undiscounted two-person zero-sum stochastic games
Date
1999-12-07
Author
Baykal-gürsoy, Melike
Avşar, Zeynep Müge
Metadata
Show full item record
Item Usage Stats
108
views
0
downloads
Cite This
Two-person zero-sum stochastic games are considered under the long-run average expected payoff criterion. State and action spaces are assumed finite. By making use of the concept of maximal communicating classes, the following decomposition algorithm is introduced for solving two-person zero-sum stochastic games: First, the state space is decomposed into maximal communicating classes. Then, these classes are organized in an hierarchical order where each level may contain more than one maximal communicating class. Best stationary strategies for the states in a maximal communicating class at a level are determined by using the best stationary strategies of the states in the previous levels that are accessible from that class. At the initial level, a restricted game is defined for each closed maximal communicating class and these restricted games are solved independently. It is shown that the proposed decomposition algorithm is exact in the sense that the solution obtained from the decomposition procedure gives the best stationary strategies for the original stochastic game.
Subject Keywords
Decomposition
,
Undiscounted stochastic games
URI
https://hdl.handle.net/11511/81034
http://repository.bilkent.edu.tr/handle/11693/25238
http://repository.bilkent.edu.tr/bitstream/handle/11693/25238/bilkent-research-paper.pdf?sequence=1
Conference Name
38th IEEE Conference on Decision and Control, IEEE Control Systems Society, Institute of Electrical and Electronics Engineers
Collections
Department of Industrial Design, Conference / Seminar
Suggestions
OpenMETU
Core
A decomposition approach for undiscounted two-person zero-sum stochastic games
Avşar, Zeynep Müge (Springer Science and Business Media LLC, 1999-06-01)
Two-person zero-sum stochastic games are considered under the long-run average expected payoff criterion. State and action spaces are assumed finite. By making use of the concept of maximal communicating classes, the following decomposition algorithm is introduced for solving two-person zero-sum stochastic games: First, the state space is decomposed into maximal communicating classes. Then, these classes are organized in an hierarchical order where each level may contain more than one maximal communicating ...
A Stochastic Maximum Principle for a Markov Regime-Switching Jump-Diffusion Model with Delay and an Application to Finance
Savku, Emel; Weber, Gerhard Wilhelm (2018-11-01)
We study a stochastic optimal control problem for a delayed Markov regime-switching jump-diffusion model. We establish necessary and sufficient maximum principles under full and partial information for such a system. We prove the existence-uniqueness theorem for the adjoint equations, which are represented by an anticipated backward stochastic differential equation with jumps and regimes. We illustrate our results by a problem of optimal consumption problem from a cash flow with delay and regimes.
An error analysis of iterated defect correction methods for linear differential-algebraic equations
Karasözen, Bülent (1996-01-01)
Asymptotic expansions of the global error of iterated defect correction (IDeC) techniques based on the implicit Euler method for linear differential-algebraic equations (dae's) of arbitrary index are analyzed. The dependence of the maximum attainable convergence order on the degree of the interpolating polynomial, number of defect correction steps, and on the index of the differential-algebraic system is given. The efficiency of IDeC method and extrapolation is compared on the basis of numerical experiments...
A STOCHASTIC APPROACH TO MODEL HOUSING MARKETS: THE US HOUSING MARKET CASE
YILMAZ, BİLGİ; Kestel, Sevtap Ayşe (2018-12-01)
This study aims to estimate the price changes in housing markets using a stochastic process, which is defined in the form of stochastic differential equations (SDEs). It proposes a general SDEs system on the price structure in terms of house price index and mortgage rate to establish an effective process. As an empirical analysis, it applies a calibration procedure to an SDE on monthly S&P/Case-Shiller US National Home Price Index (HPI) and 30-year fixed mortgage rate to estimate parameters of differentiabl...
ON FOUNDATIONS OF PARAMETER ESTIMATION FOR GENERALIZED PARTIAL LINEAR MODELS WITH B-SPLINES AND CONTINUOUS OPTIMIZATION
TAYLAN, PAKİZE; Weber, Gerhard Wilhelm; Liu, Lian (2010-02-04)
Generalized linear models are widely-used statistical techniques. As an extension, generalized partial linear models utilize semiparametric methods and augment the usual parametric terms by a single nonparametric component of a continuous covariate. In this paper, after a short introduction, we present our model in the generalized additive context with a focus on penalized maximum likelihood and on the penalized iteratively reweighted least squares (P-IRLS) problem based on B-splines which is attractive for...
Citation Formats
IEEE
ACM
APA
CHICAGO
MLA
BibTeX
M. Baykal-gürsoy and Z. M. Avşar, “A decomposition approach for undiscounted two-person zero-sum stochastic games,” Arizona, Amerika Birleşik Devletleri, 1999, p. 576, Accessed: 00, 2021. [Online]. Available: https://hdl.handle.net/11511/81034.