Exploring New Frontiers: XCEEMDAN, Bidirectional LSTM, Attention Mechanism, and Spline in Stock Price Forecasting

Kelvin Kelvin; Frans Mikael Sinaga; Sunaryo Winardi; Susmanto Susmanto

doi:10.24014/ijaidm.v7i2.29649

Exploring New Frontiers: XCEEMDAN, Bidirectional LSTM, Attention Mechanism, and Spline in Stock Price Forecasting

Kelvin Kelvin, Frans Mikael Sinaga, Sunaryo Winardi, Susmanto Susmanto

Abstract

The Attention Mechanism is acknowledged as a machine learning method proficient in managing relationships within sequential data, surpassing traditional models in this regard. However, the unique characteristics of stock data, including substantial volatility, multidimensionality, and non-linear patterns, present challenges in attaining accurate forecasts of stock prices. This research aims to tackle these hurdles by enhancing a prior model through the incorporation of an Attention Mechanism, resulting in an enhanced model. The forecasted data are standardized and prepared for analysis before undergoing signal decomposition into high and low-frequency components. Subsequently, the Attention Mechanism processes the high-frequency signals. Evaluation entails comparing the performance of the proposed model with that of the previous model using identical parameters. The findings indicate that the proposed model achieves a reduced RMSE value of 0.5708777053 compared to the previous model's average RMSE value of 0.5823726212, indicating enhanced accuracy in stock price prediction. This approach is anticipated to make a substantial contribution to the advancement of more dependable and effective stock price prediction models, addressing the limitations of prior methodologies

Keywords

Attention Mechanism; Bidirectional LSTM; Stock Price Prediction; Spline; XCEEMDAN

Full Text:

PDF

References

O. Hegazy, OS Soliman, and MA Salam, “A Machine Learning Model for Stock Market Prediction,” Int. J. Comput. science. Telecommun., vol. 4, no. May 2014, pp. 17–23, 2014, [Online]. Available: http://arxiv.org/abs/1402.7351.

M. Jia, J. Huang, L. Pang, and Q. Zhao, “Analysis and Research on Stock Price of LSTM and Bidirectional LSTM Neural Network,” in International Conference on Computer Engineering, Information Science & Application Technology (ICCIA 2019) Analysis , 2019, vol. 90, no. Iccia, pp. 467–473, doi:10.2991/iccia-19.2019.72.

Z. Jin, Y. Yang, and Y. Liu, “Stock closing price prediction based on sentiment analysis and LSTM,” Neural Comput. Appl., vol. 32, no. 13, pp. 9713–9729, 2020, doi:10.1007/s00521-019-04504-2.

R. De Luca Avila and G. De Bona, “Financial Time Series Forecasting via CEEMDAN-LSTM with Exogenous Features,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2020, vol. 12320 LNAI, pp. 558–572, doi:10.1007/978-3-030-61380-8_38.

P. Flandrin, E. Torres, and MA Colominas, “A COMPLETE ENSEMBLE EMPIRICAL MODE DECOMPOSITION,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2011, pp. 4144–4147, doi:10.109/ICASSP.2011.5947265.

M. Roondiwala, H. Patel, and S. Varma, “Predicting Stock Prices Using LSTM,” Int. J. Sci. Res., vol. 6, no. 4, pp. 2319–7064, 2015, [Online]. Available: https://www.quandl.com/data/NSE.

Z. Cui, R. Ke, Z. Pu, and Y. Wang, “Stacked bidirectional and unidirectional LSTM recurrent neural network for network-wide traffic speed prediction,” arXiv, pp. 1–11, 2018

J. Cao, Z. Li, and J. Li, “Financial time series forecasting model based on CEEMDAN and LSTM,” Phys. A Stats. mech. its Appl., vol. 519, pp. 127–139, 2019, doi:10.1016/j.physa.2018.11.061.

Y. Xuan, Y. Yu, and K. Wu, “Prediction of Short-term Stock Prices Based on EMD-LSTM-CSI Neural Network Method,” IEEE Int. conf. Big Data Anal., pp. 135–139, 2020, doi:10.1109/ICBDA490404.2020.9101194.

S. Siami-Namini, N. Tavakoli, and AS Namin, “The Performance of LSTM and BiLSTM in Forecasting Time Series,” in Proceedings - 2019 IEEE International Conference on Big Data, Big Data 2019, 2019, pp. 3285–3292, doi:10.109/BigData470990.2019.9005997.

Zulfikar, Introduction to Capital Markets with a Statistical Approach. 2016.

M. Vijh, D. Chandola, VA Tikkiwal, and A. Kumar, “Stock Closing Price Prediction using Machine Learning Techniques,” Procedia Comput. Sci., vol. 167, no. 2019, pp. 599–606, 2020, doi:10.1016/j.procs.2020.03.326.

NE Huang, Z. Shen, and SR Long, “A NEW VIEW OF NONLINEAR WATER WAVES : The Hilbert Spectrum 1,” 1999.

M. Camilleri, “Forecasting Using Non-Linear Techniques In Time Series Analysis: An Overview Of Techniques and Main Issues,” Univ. Malta Comput. science. soo. res. Work., pp. 19–28, 2004.

Z. Wu and NE Huang, “Ensemble Empirical Mode Decomposition : A Noise Assisted Data Analysis Method,” no. August, 2005.

M. Rosidi, Numerical Method Using R for Environmental Engineering. 2019.

I. James P. Howard, Computational Methods for Numerical Analysis with R. Taylor & Francis Group, LLC,

Kelvin, Ronsen Purba, and Arwin Halim, "Stock Price Prediction Using XCEEMDAN-Bidirectional LSTM-Spline," Indonesian Journal of Artificial Intelligence and Data Mining (IJAIDM), vol. 5, no. 1, pp. 1-12, Mar. 2022, https://doi.org/10.24014/ijaidm.v5i1.14424.

Zhang, J., Ye, L., & Lai, Y. (2023). Stock Price Prediction Using CNN-BiLSTM-Attention Model. Retrieved from https://doi.org/10.3390/math11091985

Lin, Y., Yan, Y., Xu, J., Liao, Y., & Ma, F. (2021). Forecasting stock index price using the CEEMDAN-LSTM model. North American Journal of Economics and Finance, 57, 101421. DOI: 10.1016/j.najef.2021.101421.

DOI: http://dx.doi.org/10.24014/ijaidm.v7i2.29649

Refbacks

There are currently no refbacks.

Office and Secretariat:

Big Data Research Centre
Puzzle Research Data Technology (Predatech)
Laboratory Building 1st Floor of Faculty of Science and Technology
UIN Sultan Syarif Kasim Riau

Jl. HR. Soebrantas KM. 18.5 No. 155 Pekanbaru Riau – 28293
Website: http://predatech.uin-suska.ac.id/ijaidm
Email: ijaidm@uin-suska.ac.id
e-Journal: http://ejournal.uin-suska.ac.id/index.php/ijaidm
Phone: 085275359942

Journal Indexing:

IJAIDM Stats