Derivative free algorithms for large scale non-smooth optimization and their applications

Download
2013
Tor, Ali Hakan
In this thesis, various numerical methods are developed to solve nonsmooth and in particular, nonconvex optimization problems. More specifically, three numerical algorithms are developed for solving nonsmooth convex optimization problems and one algorithm is proposed to solve nonsmooth nonconvex optimization problems. In general, main differences between algorithms of smooth optimization are in the calculation of search directions, line searches for finding step-sizes and stopping criteria. However, in nonsmooth optimiza- tion there is one additional difference between algorithms. These al gorithms may use different gener- alizations of the gradient. In order to develop algorithms for solving nonsmooth convex optimization problems we use the concept of codifferential. Although there exists the odifferential calculus, the calculation of the whole codifferential is not an easy task. Therefore, in the first numerical method, only a few elements of the codifferential are used to calculate search directions. In order to reduce the number of codifferential evaluations, in the second method elements of the codifferential calculated in previous iterations are used to calculate search directions. In both the first and second methods the problem of calculation of search directions is reduced to the solution of a certain quadratic programming problem. The size of this problem can increase significantly as the number of variables increases. In order to avoid this problem in the third method, called the aggregate codifferential method, the number of elements of the codifferential used to find search directions is fixed. Such an approach allows one to significantly reduce the complexity of codifferential methods and to make them applicable for solving large scale problems of nonsmooth optimization. These methods are applied to some well-known nonsmooth optimization test problems, such as, min-max and general type nonsmooth optimization problems. The obtained numerical results are visualized using performance profiles. In addition, the validation of these methods is made by comparing them with the subgradient and bundle methods using results of numerical experiments. The convergence of methods is analyzed. Finally, the first method is extended to minimize nonsmooth convex functions subject to linear inequalities using slack variables. The notion of quasisecant is used to design an algorithm for solving nonsmooth nonconvex unconstrained optimization problems. In this method, to find descent direction the subgradient algorithm is applied for the solution of a set of linear inequalities. The convergence of the proposed method is analyzed, and the numerical experiments are carried out using general type nonsmooth optimization test problems. To validate this method, the results are compared with those by the subgradient method.

Suggestions

Derivative free optimization methods for optimizing stirrer configurations
Uğur, Ömür; SCHAEFER, M.; YAPICI, KEREM (2008-12-16)
In this paper a numerical approach for the optimization of stirrer configurations is presented. The methodology is based on a flow solver, and a mathematical optimization tool, which are integrated into an automated procedure. The flow solver is based on the discretization of the incompressible Navier-Stokes equations by means of a fully conservative finite-volume method for block-structured, boundary-fitted grids, for allowing a flexible discretization of complex stirrer geometries. Two derivative free opt...
Discrete gradient method: Derivative-free method for nonsmooth optimization
Bagirov, A. M.; Karasözen, Bülent; Sezer, M. (2008-05-01)
A new derivative-free method is developed for solving unconstrained nonsmooth optimization problems. This method is based on the notion of a discrete gradient. It is demonstrated that the discrete gradients can be used to approximate subgradients of a broad class of nonsmooth functions. It is also shown that the discrete gradients can be applied to find descent directions of nonsmooth functions. The preliminary results of numerical experiments with unconstrained nonsmooth optimization problems as well as th...
Derivative free optimization of stirrer configurations
Schaefer, M.; Karasözen, Bülent; Uğur, Ömür; Yapici, K. (2005-07-01)
In the present work a numerical approach for the optimization of stirrer configurations is presented. The methodology is based on a parametrized grid generator, a flow solver, and a mathematical optimization tool, which are integrated into an automated procedure. The grid generator allows the parametrized generation of block-structured grids for the stirrer geometries. The flow solver is based on the discretization of the incompressible Navier-Stokes equations by means of a fully conservative finite-volume ...
DERIVATIVE FREE MULTILEVEL OPTIMIZATION
Karasözen, Bülent (2015-01-01)
Optimization problems with different levels arise by discretization of ordinary and partial differential equations. We present a trust-region based derivative-free multilevel optimization algorithm. The performance of the algorithm is shown on a shape optimization problem and global convergence to the first order critical point is proved.
Exact decomposition algorithms for nonlinear location and hub location problems
Gündoğdu, Emine; Gürel, Sinan; Department of Industrial Engineering (2018)
Developing exact solution algorithms to solve difficult optimization problems is one of the most important subjects in the operations research literature. In this dissertation, we develop Benders decomposition based exact solution algorithms (BDTAs) for handling nonlinearity in three selected nonlinear integer location/hub location problems. The first and second problem include nonlinear capacity constraints, while in the last problem, both objective function and the capacity constraints are nonlinear. In o...
Citation Formats
A. H. Tor, “Derivative free algorithms for large scale non-smooth optimization and their applications,” Ph.D. - Doctoral Program, Middle East Technical University, 2013.