Randomized control limit policies for Markov decision processes with linear constraints

Download
093296.pdf
1999
Fidan, Nihan
Show full item record
81
views
0
downloads
https://hdl.handle.net/11511/2753
Graduate School of Natural and Applied Sciences, Thesis

Suggestions

Random Set Methods Estimation of Multiple Extended Objects
Granstrom, Karl; Lundquist, Christian; Gustafsson, Fredrik; Orguner, Umut (Institute of Electrical and Electronics Engineers (IEEE), 2014-06-01)
Random set-based methods have provided a rigorous Bayesian framework and have been used extensively in the last decade for point object estimation. In this article, we emphasize that the same methodology offers an equally powerful approach to estimation of so-called extended objects, i.e., objects that result in multiple detections on the sensor side. Building upon the analogy between Bayesian state estimation of a single object and random finite set (RFS) estimation for multiple objects, we give a tutorial...
Random effects’ distribution assumption on joint mixed modelling
Özdemir, Celal Oğuz; Kalaylıoğlu Akyıldız, Zeynep Işıl; Department of Statistics (2018)
Joint mixed model is an appealing approach in medical research where it is critical to estimate the odds of a fatal complication that occurs to a patient given the covariate profile such as a risk factor observed over time. For this kind of estimation, joint mixed model is used. In the standard Bayesian analysis of the model, the error variance and random effects’ variance-covariance matrix are apriori modeled independently with Inverse-Gamma and Inverse-Wishart distributions respectively. Recently however,...
Randomness properties of some vector sequences generated by multivariate polynomial iterations
Gürkan Balıkçıoğlu, Pınar; Diker Yücel, Melek; Department of Cryptography (2016)
We examine the randomness properties of the sequences generated by the multivariate polynomial iterations method proposed by Ostafe and Shparlinski, by using the six different choices of polynomials given by the same authors. Our analysis is based on two approaches: distributions of the periods and linear complexities of the produced vector sequences. We define the efficiency parameters, PE for “period efficiency” and LCE for “linear complexity efficiency”, so that the actual values of the period and linear com...
Random Matrix Based Extended Target Tracking with Orientation: A New Model and Inference
Tuncer, Barkın; Özkan, Emre (2021-02-01)
In this study, we propose a novel extended target tracking algorithm which is capable of representing the extent of dynamic objects as an ellipsoid with a time-varying orientation angle. A diagonal positive semi-definite matrix is defined to model objects' extent within the random matrix framework where the diagonal elements have inverse-Gamma priors. The resulting measurement equation is non-linear in the state variables, and it is not possible to find a closed-form analytical expression for the true poste...
Random walk particle-tracking method for modeling changes of sediment characteristics in marine sediments after drilling discharges
Özdemir, Rabia Tuğçe; Durgut, İsmail (Elsevier BV, 2019-08-01)
Adverse impacts of drilling discharges on marine benthic environments have been observed since the advent of offshore drilling operations for exploration and production of oil and gas. This study utilizes a marine sediment model based on a system of equations that has been developed earlier to assess environmental impacts of drilling waste discharges. Bioturbation, bio-degradation and natural burial processes are included in the model. The model is based on the diagenetic equations, providing vertical conce...
Citation Formats
N. Fidan, “Randomized control limit policies for Markov decision processes with linear constraints,” Middle East Technical University, 1999.
METU IIS - Integrated Information Service open@metu.edu.tr