Wavelet support vector machines and multi-elitist particle swarm optimization for time series forecasting

Jerzy Martyna

Abstract


In this paper, we present a new method for time series forecasting based on wavelet support vector machines (WSVM). To better represent any curve in L^2(R^n) space (quadratic continuous integral space), we used a new kernel function. This function is the wavelet function. The SVM with wavelet kernel function is referred to as a wavelet SVM. In order to determine the optimal parameter of the WSVM, the multi-elitist particle swarm optimization (PSO) was used. Computational results demonstrate the effectiveness of the proposed method over the traditional methods.

Keywords


wavelet support vector machine; multielitist particle swarm optimization; time series forecasting

Full Text:

PDF

References


Azadeh A., Ghaderi S. F., Tarvedian S., Saberi M.: Integration of Artificial Neural Networks and Genetic Algorithm to Predict Electrical Energy Consumption. Applied Mathematics and Computation, Vol. 186, 2007, p. 1731÷1741.

Białasiewicz J. T.: Wavelets and Approximations. Warszawa: WNT, 2000.

Box G. E. P., Jenkins G. M.: Time Series Analysis: Forecasting and Control. Holdan Day, San Francisco 1976.

Burges C. J.: A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Knowledge Discovery, 2, 1998, p. 1÷43.

Clerc M., Kennedy J.: The Particle Swarm - Explosion, Stability, and Convergence In Multidimensional Complex Space. IEEE Trans. on Evolutionary Computation, Vol. 6, No. 1, 2002, p. 58÷73.

Deb K., Pratap A., Agarwal S., Meyarivan T.: A Fast and Elitist Multiobjective Genetic Algorithm: NSGA-II. IEEE Trans. on Evolutionary Computation, Vol. 6, No. 2, 2002.

Dom Maklerski BOŚ http://bossa.pl/.

Eberhart R. C., Shi Y.: Particle Swarm Optimization: Developments, Applications and Resources. Proc. of IEEE Int. Conference on Evolutionary Computation, Vol. 1, 2001, p. 81÷86.

Haykin S.: Neural Networks: A Comprehensive Foundation. 2nd Ed., New Jersey: Prentice Hall, 1999.

Hong W. C.: Electric Load Forecasting by Support Vector Model. Applied Mathematical Modelling, Vol. 33, No. 6, p. 2444÷2454.

Hwang J. R., Chen S. M., Lee C. H.: Handling Forecasting Problems Using Fuzzy Time Series. Fuzzy Sets and systems, Vol. 100, 1998, p. 217÷228.

Khandoker A. H. K., Lai D. T. H., Begg R. K., Palaniswarni M.: Wavelet-Based Feature Extraction for Support Vector Machines for Screening Balance Impatients in the Elderly. IEEE Trans. on Neural Systems and Rehabilitation Engineering, Vol. 15, No. 4, 2007, p. 587÷597.

Lee L. W., Wang L. W., Chen S. M.: Handling Forecasting Problems Based on Two-Factor High-Order Time Series. IEEE Trans. on Fuzzy Systems, Vol. 14, No. 3, 2006, p. 468÷477.

Lu Z., Sun J., Butts K. R.: Linear Programming Support Vector Regression with Wavelet Kernel: A New Approach to Nonlinear Dynamical System Identification. Mathematics and Computers in Simulation, Vol. 79, 2009, p. 2051÷2063.

McQuarrie A. D. R., Tsai Ch.-L.: Regression and Time Series Model Selection. World Scientific, 1998.

Mercer J.: Functions of Positive and Negative Type and Their Connection with the Theory of Integral Equations. Philos. Trans. Roy. Soc., London, 209 (1909), p. 415÷446.

Piramuthu S.: Theory and Methodology - Financial Credit-Risk Evaluation with Neural and Neural-Fuzzy Systems. European Journal of Operational Research, Vol. 112, 1991, p. 310÷321.

Rodionov S. N., Martin J. H.: An Expert System-Based Approach to Prediction of Yearto-Year Climatic Variations in the North Atlantic Region. International Journal of Climatology, Vol. 19, 1999, p. 951÷974.

Widodo A., Yang B. S.: Wavelet Support Vector Machine for Induction Machine Fault Diagnosis Based on Transient Current Signal. Expert Systems and Applications, Vol. 35, No. 1-2, 2008, p. 307÷316.

Wu C. H., Tzeng G. H., Lin R. H.: A Novel Hybrid Genetic Algorithm for Kernel Function and Parameter Optimization in Support Vector Regression. Expert Systems Applications, Vol. 36, No. 4, p. 4725÷4735.

Vapnik V. N.: The Nature of Statistical Learning. New York: Springer Verlag, 1995.

Vapnik V. N.: Statistical Learning Theory, New York: JohnWiley and Sons, 1998.

Zhang G. P., Patuwo B. E., Hu Y. M.: Forecasting with Artificial Neural Networks: The State of the Art. Int. Journal of Forecasting, Vol. 14, 1998, p. 35÷62.




DOI: http://dx.doi.org/10.21936/si2011_v32.n2A.277