Optimal control of stochastic hybrid system with jumps: A numerical approximation

2014-03-15
Temoçin, Büşra Zeynep
Weber, Gerhard Wilhelm
The generalized class of stochastic hybrid systems consists of models with regime changes including the occurrence of impulsive behavior. In this paper, the stochastic hybrid processes with jumps are approximated by locally consistent Markov decision processes that preserve local mean and covariance. We further apply a randomized switching policy for approximating the dynamics on the switching boundaries. To investigate the validity of the approximation, we study a stochastic optimal control problem. On the basis of the discrete approximation, we solve the optimal control problem and show that the solution obtained from the discretized problem converges to the solution of the original optimal control problem.
JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS

Suggestions

Stochastic simulations of biological networks under impulses
Yazıcı, Müge; Purutçuoğlu Gazi, Vilda; Department of Statistics (2016)
The impulses are one of the sources of fluctuations which lead to the sharp changes in the biochemical systems such as the changes in epidemic and population models. In this study, as the novelty, we implement these effects in exact stochastic simulation algorithms, namely, the Gillespie method and the first reaction method, by changing the chemical master equations (CME) with impulses. Hereby in the extension of these approaches with impulses, we consider different scenarios such as the sudden decrease of ...
Optimal Limit Order Book Trading Strategies with Stochastic Volatility in the Underlying Asset
Aydoğan, Burcu; Uğur, Ömür; Aksoy, Ümit (2022-1-01)
In quantitative finance, there have been numerous new aspects and developments related with the stochastic control and optimization problems which handle the controlled variables of performing the behavior of a dynamical system to achieve certain objectives. In this paper, we address the optimal trading strategies via price impact models using Heston stochastic volatility framework including jump processes either in price or in volatility of the price dynamics with the aim of maximizing expected return of t...
Application of stochastic simulations of biological networks under different impulsive scenarios
Purutçuoğlu Gazi, Vilda (null; 2016-06-01)
The impulses are one of the sources of fluctuations which lead to the sharp changes in the biochemical systems such as the changes in epidemic and population models. These effects have been comprehensively studied under deterministic models, whereas, have not been analyzed in stochastic models. Hereby, in this study, we implement these effects in two exact stochastic simulation algorithms, namely, the direct method and the first reaction method under different dimensional systems and impulses scenarios. In ...
Quantitative measures of observability for stochastic systems
Subaşı, Yüksel; Demirekler, Mübeccel; Department of Electrical and Electronics Engineering (2012)
The observability measure based on the mutual information between the last state and the measurement sequence originally proposed by Mohler and Hwang (1988) is analyzed in detail and improved further for linear time invariant discrete-time Gaussian stochastic systems by extending the definition to the observability measure of a state sequence. By using the new observability measure it is shown that the unobservable states of the deterministic system have no effect on this measure and any observable part wit...
Hierarchical control with partial observations: Sufficient conditions
Boutin, Olivier; Komenda, Jan; Masopust, Tomas; Schmidt, Klaus Verner; Van Schuppen, Jan H. (2011-12-01)
In this paper, hierarchical control of both monolithic and modular discrete-event systems under partial observations is studied. Two new conditions, called observation consistency and local observation consistency, are proposed. These conditions are sufficient for the preservation of observability between the original and the abstracted plant. Moreover, it is shown that both conditions are compositional, that is, they are preserved by the synchronous product. This property makes it possible to use hierarchi...
Citation Formats
B. Z. Temoçin and G. W. Weber, “Optimal control of stochastic hybrid system with jumps: A numerical approximation,” JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, pp. 443–451, 2014, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/56845.