Scholars Central

Conference abstractPublished 2018

Stock market real time recommended model in big data framework using Apache Spark

Authors: Essam M Ramzy Hamed, Mostafa Mohamed Seif, A Hegazy

Arab Academy for Science, Technology and Maritime Transport, Egypt

Ask about this article

Abstract

Select any words in the title or abstract, or press this and choose a sentence.

Stock market is considered as a complicated and nonlinear system. Now stock market prediction is recognized as an attracting point for financial investors. The historical price is not considered as the main factor to predict stock market trend. There are many factors such as politics and natural events that affect social media environments like Twitter and Facebook that generate huge datasets and need data analysis to extract the polarity of the data and its effectiveness on the stock market. On the other hand, this data may be unstructured and may need special handling on storing and processing. This paper proposes a real time forecasting of stock market trends based on news, tweets, and historical price. A supervised machine learning algorithm is used to build this model. Historical price will have to be combined with sentiment analysis to build hybrid model based on Apache Spark and Hadoop HDFS to handle big data (structured and unstructured) generated from social media and news websites. The proposed model works on two modes; offline mode that works on historical data included today’s data after ending of stock market session and real time mode that works on real time data. This model increases the accuracy of prediction due to the additional features added by sentiment analysis on StockTwits and market news data. Additionally, the model enhances the performance of handling this data set due to parallel processing occurred on data using Apache Spark.

Ask about this article

Answers come only from this article's title, abstract and keywords, each sentence pointing to where it comes from. Your question is sent to OpenAI to write the answer. Scholars Central does not store it.

Try:

Similar by topic

More from this journal

The newest in Journal of Computer Engineering & Information Technology.

All its articles

Conferences in this field

Upcoming conferences in this field.

Follow

New articles from what you follow go into your email digest, once you agree to alert emails.

  • JournalJournal of Computer Engineering & Information Technology
  • SubjectComputer Science & IT
  • SubjectEngineering
  • BylineArticles whose byline prints “Essam M Ramzy Hamed”
  • BylineArticles whose byline prints “Mostafa Mohamed Seif”
  • BylineArticles whose byline prints “A Hegazy”

For authors and organisers

Publish, present and keep up with your field

Find the right journal for your paper and submit your manuscript.

Photo: Pexels