Mutual information model selection algorithm for time series

2020-09-01
Time series model selection has been widely studied in recent years. It is of importance to select the best model among candidate models proposed for a series in terms of explaining the procedure that governs the series and providing the most accurate forecast for the future observations. In this study, it is aimed to create an algorithm for order selection in Box-Jenkins models that combines penalized natural logarithm of mutual information among the original series and predictions coming from each candidate. The penalization is achieved by subtracting the number of parameters in each candidate and empirical information the data provide.Simulation studies under various scenarios and applications on real data sets imply that our algorithm offers a promising and satisfactory alternative to its counterparts.
JOURNAL OF APPLIED STATISTICS

Suggestions

Time series AR(1) model for short-tailed distributions
Akkaya, AD; Tiku, ML (Informa UK Limited, 2005-04-01)
The innovations in AR(1) models in time series have primarily been assumed to have a normal or long-tailed distributions. We consider short-tailed distributions (kurtosis less than 3) and derive modified maximum likelihood (MML) estimators. We show that the MML estimator of 0 is considerably more efficient than the commonly used least squares estimator and is also robust. This paper is essentially the first to achieve robustness to inliers and to various forms of short-tailedness in time series analysis.
Multiple linear regression model with stochastic design variables
İslam, Muhammed Qamarul (Informa UK Limited, 2010-01-01)
In a simple multiple linear regression model, the design variables have traditionally been assumed to be non-stochastic. In numerous real-life situations, however, they are stochastic and non-normal. Estimators of parameters applicable to such situations are developed. It is shown that these estimators are efficient and robust. A real-life example is given.
Estimation and hypothesis testing in multivariate linear regression models under non normality
İslam, Muhammed Qamarul (Informa UK Limited, 2017-01-01)
This paper discusses the problem of statistical inference in multivariate linear regression models when the errors involved are non normally distributed. We consider multivariate t-distribution, a fat-tailed distribution, for the errors as alternative to normal distribution. Such non normality is commonly observed in working with many data sets, e.g., financial data that are usually having excess kurtosis. This distribution has a number of applications in many other areas of research as well. We use modifie...
Regression analysis with a dtochastic design variable
Sazak, HS; Tiku, ML; İslam, Muhammed Qamarul (Wiley, 2006-04-01)
In regression models, the design variable has primarily been treated as a nonstochastic variable. In numerous situations, however, the design variable is stochastic. The estimation and hypothesis testing problems in such situations are considered. Real life examples are given.
Representation of Multiplicative Seasonal Vector Autoregressive Moving Average Models
Yozgatlıgil, Ceylan (Informa UK Limited, 2009-11-01)
Time series often contain observations of several variables and multivariate time series models are used to represent the relationship between these variables. There are many studies on vector autoregressive moving average (VARMA) models, but the representation of multiplicative seasonal VARMA models has not been seriously studied. In a multiplicative vector model, such as a seasonal VARMA model, the representation is not unique because of the noncommutative property of matrix multiplication. In this articl...
Citation Formats
E. Akca and C. Yozgatlıgil, “Mutual information model selection algorithm for time series,” JOURNAL OF APPLIED STATISTICS, pp. 2192–2207, 2020, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/38421.