Stock Market Analysis and Prediction using Hadoop and Machine Learning

Authors

  • Jain P Department of CSE, Shri Ramdeobaba College of Engineering and Management, Nagpur
  • Bhat K Department of CSE, Shri Ramdeobaba College of Engineering and Management, Nagpur
  • HarshalKesharwani Department of CSE, Shri Ramdeobaba College of Engineering and Management, Nagpur
  • Bhate P Department of CSE, Shri Ramdeobaba College of Engineering and Management, Nagpur
  • Khurana KP Department of CSE, Shri Ramdeobaba College of Engineering and Management, Nagpur

DOI:

https://doi.org/10.26438/ijcse/v6i5.578584

Keywords:

Hadoop, Map-reduce, Machine learning, Sentiment analysis, Stock Market

Abstract

The share market is the new business for many individuals and companies.The stock market attracts many as there is a huge profitinvolved. But there can be huge loss as well. The world suffered from many economic crises due to itsdownfall, which may have cost lives and way of living of many. If the share prices couldbe predicted, this can help in avoiding the economic crisis.Many business analysts said that the share market cannot be predicted and it is completelyrandom, but there is no common opinion about that. Many also said that it can bepredicted but with using different measures. In this paper, we have proposed a technique to perform stock market data analysis to find if there exists a relation between stock price change of two companies- TCS and Infosys. This is done using Big data technique by performing sentiment analysis of Tweets from Twitter and finding the correlation. Also, machine learning techniques are applied on the BSE data of the companies to predict the stock prices of next day. The results of allthe factors like sentiments, similar industrial shares, and index shares are combined to get to the conclusion. We found that the share market depends on the numerous factors and considering only certain factorsare insufficient for analysis.

References

B. G. Malkiel, “A Random Walk Down Wall Street”, W. W. Norton,

New York. 1973.

R. Iacomin, “Stock Market Prediction,”2015 19th International Conference on System Theory, Control and Computing (ICSTCC), October 14-16, CheileGradistei, Romania

S., Kamath, “Stock Market Analysis,” Master's Projects, pp. 326, 2012.

V. Rajput, S.Bobde, “Stock Market Forecasting Techniques: Literature Survey,” International Journal of Computer Science and Mobile Computing, 5(6), June 2016, 500-506.

G. S., Navale, N., Dudhwala, K., Jadhav, P., Gabda, & B. J., Vihangam. , “Prediction of Stock Market using Data Mining and Artificial Intelligence,” International Journal of Computer Science and MobileComputing, 134(12), January 2012, pp 9-11.

A. Gupta and B. Dhingra, "Stock market prediction using Hidden Markov Models," 2012 Students Conference on Engineering and Systems, Allahabad, Uttar Pradesh, 2012, pp. 1-4.

P. Somani, S. Talele and S. Sawant, "Stock market prediction using Hidden Markov Model," 2014 IEEE 7th Joint International Information Technology and Artificial Intelligence Conference, Chongqing, 2014, pp. 89-92.

Z. Zhang, Y. Shen, G. Zhang, Y. Song and Y. Zhu, "Short-term prediction for opening price of stock market based on self-adapting variant PSO-Elman neural network," 2017 8th IEEE International Conference on Software Engineering and Service Science (ICSESS), Beijing, China, 2017, pp. 225-228.

M. Naeini, H. Taremian and H. Hashemi, “Stock Market Value Prediction Using Neural Networks,” International Conference on Computer InformationSystems and Industrial Management Applications (CISIM) 2010.

A. Rao, S. Hule, H. Shaikh, E. Nirwan and P. M. Daflapurkar, "Survey: Stock Predictive Models Using Multilayer Perceptron", International Journal of Computer Sciences and Engineering, Vol.4, Issue.5, pp.111-113, 2016.

S. Asadifar and M. Kahani, "Semantic association rule mining: A new approach for stock market prediction," 2017 2nd Conference on Swarm Intelligence and Evolutionary Computation (CSIEC), Kerman, 2017, pp. 106-111.

M. R. Vargas, B. S. L. P. de Lima and A. G. Evsukoff, "Deep learning for stock market prediction from financial news articles," 2017 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA), Annecy, 2017, pp. 60-65.

Jiahong Li, Hui Bu and Junjie Wu, "Sentiment-aware stock market prediction: A deep learning method," 2017 International Conference on Service Systems and Service Management, Dalian, 2017, pp. 1-6.

W. Chen, Y. Zhang, C. K. Yeo, C. T. Lau and B. S. Lee, "Stock market prediction using neural network through news on online social networks," 2017 International Smart Cities Conference (ISC2), Wuxi, 2017, pp. 1-6.

S. Gour, "Developing Decision Model by Mining Historical Prices Data of Infosys for Stock Market Prediction", International Journal of Computer Sciences and Engineering, Vol.4, Issue.10, pp.92-97, 2016.

J.K.Sharma, “Business Statistics,” Pearson Education, India, pp. 454-455, 2007.

P.Domingos, “A Few Useful Things to Know about Machine Learning,” Communications of the ACM, Vol. 55 No. 10, October 2012, Pages 78-87.

Downloads

Published

2025-11-13
CITATION
DOI: 10.26438/ijcse/v6i5.578584
Published: 2025-11-13

How to Cite

[1]
P. Jain, K. Bhat, HarshalKesharwani, P. Bhate, and K. P. Khurana, “Stock Market Analysis and Prediction using Hadoop and Machine Learning”, Int. J. Comp. Sci. Eng., vol. 6, no. 5, pp. 578–584, Nov. 2025.

Issue

Vol. 6 No. 5 (2018): IJCSE May Edition

Section

Research Article

License

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors contributing to this journal agree to publish their articles under the Creative Commons Attribution 4.0 International License, allowing third parties to share their work (copy, distribute, transmit) and to adapt it, under the condition that the authors are given credit and that in the event of reuse or distribution, the terms of this license are made clear.