Stocks Analysis and Prediction Using Big Data Analytics
Keywords:
Stock Analysis, Machine Learning, Stock Prediction, Big Data, LSTM, Stock Price PredictionAbstract
Big data analytics plays a crucial role in various sectors, enabling the accurate prediction and analysis of large datasets. This approach focuses on stock market prediction, where large volumes of stock data are processed to predict daily gains or losses. By utilizing big data tools, such as the PySpark API, streaming or batch data is processed to generate predictions based on historical stock information. The goal is to identify patterns in stock price movements and predict future trends with a high level of accuracy. Performance is evaluated using R-squared metrics, ensuring that the most effective model is selected. Among the models tested, the Long Short-Term Memory (LSTM) algorithm demonstrates the highest predictive accuracy, achieving an R-squared value of 0.97%. This result highlights LSTM's capability to closely match predicted stock prices with actual test data, offering a reliable solution for stock market forecasting. The approach showcases the potential of big data and machine learning in financial analysis, helping investors make informed decisions based on historical trends and future predictions.
Downloads
Metrics
References
L. Zhao and L. Wang, “Price Trend Prediction of Stock Market Using Outlier Data Mining Algorithm,” in 2015 IEEE Fifth International Conference on Big Data and Cloud Computing, Dalian, China, 2015, pp. 93–98.
M.D. Jaweed and J. Jebathangam, “Analysis of stock market by using Big Data Processing Environment” in International Journal of Pure and Applied Mathematics, Volume 119
S. Tiwari, A. Bharadwaj, and S. Gupta, “Stock price prediction using data analytics,” in 2017 International Conference on Advances in Computing, Communication and Control (ICAC3), Mumbai, 2017, pp. 1–5
P. Singh and A. Thakral, “Stock market: Statistical analysis of its indexes and its constituents,” in 2017 International Conference On Smart Technologies For Smart Nation (SmartTechCon), Bangalore, 2017, pp. 962–966.
Z. Peng, “Stocks Analysis and Prediction Using Big Data Analytics,” in 2019 International Conference on Intelligent Transportation, Big Data & Smart City (ICITBS), Changsha, China, 2019, pp. 309–312.
G. V. Attigeri, Manohara Pai M M, R. M. Pai, and A. Nayak, “Stock market prediction: A big data approach,” in TENCON 2015 - 2015 IEEE Region 10 Conference, Macao, 2015, pp. 1–5.
W.-Y. Huang, A.-P. Chen, Y.-H. Hsu, H.-Y. Chang, and M.-W. Tsai, “Applying Market Profile Theory to Analyze Financial Big Data and Discover Financial Market Trading Behavior - A Case Study of Taiwan Futures Market,” in 2016 7th International Conference on Cloud Computing and Big Data (CCBD), Macau, China, 2016, pp. 166–169.
S. Jeon, B. Hong, J. Kim, and H. Lee, “Stock Price Prediction based on Stock Big Data and Pattern Graph Analysis:,” in Proceedings of the International Conference on Internet of Things and Big Data, Rome, Italy, 2016, pp. 223–231.
R. Choudhry and K. Garg, “A Hybrid Machine Learning System for Stock Market Forecasting,” vol. 2, no. 3, p. 4, 2008.
K. Kim, “Financial time series forecasting using support vector machines,” Neurocomputing, vol. 55, no. 1–2, pp. 307–319, Sep. 2003.
M. Makrehchi, S. Shah, and W. Liao, “Stock Prediction Using EventBased Sentiment Analysis,” in 2013 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT), Atlanta, GA, USA, 2013, pp. 337–342.
H. Pouransari and H. Chalabi, “Event-based stock market prediction,” p. 5.
.
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution 4.0 International License.
You are free to:
- Share — copy and redistribute the material in any medium or format
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
Terms:
- Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
