Dynamic programming for a Markov-switching jump-diffusion

Date

2014-09-01

Author

Azevedo, N.
Pinheiro, D.
Weber, Gerhard Wilhelm

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

291
views

0
downloads

We consider an optimal control problem with a deterministic finite horizon and state variable dynamics given by a Markov-switching jump-diffusion stochastic differential equation. Our main results extend the dynamic programming technique to this larger family of stochastic optimal control problems. More specifically, we provide a detailed proof of Bellman's optimality principle (or dynamic programming principle) and obtain the corresponding Hamilton-Jacobi-Belman equation, which turns out to be a partial integro-differential equation due to the extra terms arising from the Levy process and the Markov process. As an application of our results, we study a finite horizon consumption-investment problem for a jump-diffusion financial market consisting of one risk-free asset and one risky asset whose coefficients are assumed to depend on the state of a continuous time finite state Markov process. We provide a detailed study of the optimal strategies for this problem, for the economically relevant families of power utilities and logarithmic utilities.

Subject Keywords

Applied Mathematics, Computational Mathematics

URI

https://hdl.handle.net/11511/52373

Journal

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS

DOI

https://doi.org/10.1016/j.cam.2014.01.021

Collections

Graduate School of Applied Mathematics, Article

Suggestions

OpenMETU
Core

Least-squares differential quadrature time integration scheme in the dual reciprocity boundary element method solution of diffusive-convective problems Bozkaya, Canan (Elsevier BV, 2007-01-01) Least-squares differential quadrature method (DQM) is used for solving the ordinary differential equations in time, obtained from the application of dual reciprocity boundary element method (DRBEM) for the spatial partial derivatives in diffusive-convective type problems with variable coefficients. The DRBEM enables us to use the fundamental solution of Laplace equation, which is easy to implement computation ally. The terms except the Laplacian are considered as the nonhomogeneity in the equation, which ar...
Hyperbolic conservation laws on manifolds. An error estimate for finite volume schemes Lefloch, Philippe G.; Okutmuştur, Baver; Neves, Wladimir (Springer Science and Business Media LLC, 2009-07-01) Following Ben-Artzi and LeFloch, we consider nonlinear hyperbolic conservation laws posed on a Riemannian manifold, and we establish an L (1)-error estimate for a class of finite volume schemes allowing for the approximation of entropy solutions to the initial value problem. The error in the L (1) norm is of order h (1/4) at most, where h represents the maximal diameter of elements in the family of geodesic triangulations. The proof relies on a suitable generalization of Cockburn, Coquel, and LeFloch's theo...
Nonlinear oscillation of second-order dynamic equations on time scales Anderson, Douglas R.; Zafer, Ağacık (Elsevier BV, 2009-10-01) Interval oscillation criteria are established for a second-order nonlinear dynamic equation on time scales by utilizing a generalized Riccati technique and the Young inequality. The theory can be applied to second-order dynamic equations regardless of the choice of delta or nabla derivatives.
Monotone positive solutions for a class of second-order nonlinear differential equations Ertem, T.; Zafer, Ağacık (Elsevier BV, 2014-03-15) It is shown that the second-order nonlinear differential equation
Perron's theorem for linear impulsive differential equations with distributed delay Akhmet, Marat; Zafer, A. (Elsevier BV, 2006-08-15) In this paper it is shown that under a Perron condition trivial solution of linear impulsive differential equation with distributed delay is uniformly asymptotically stable.

Citation Formats

N. Azevedo, D. Pinheiro, and G. W. Weber, “Dynamic programming for a Markov-switching jump-diffusion,” JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, pp. 1–19, 2014, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/52373.