Conference abstract · 26 Sep 2018
Conference abstractPublished 2018
Stock market real time recommended model in big data framework using Apache Spark
Arab Academy for Science, Technology and Maritime Transport, Egypt
Abstract
Select any words in the title or abstract, or press this and choose a sentence.
Stock market is considered as a complicated and nonlinear system. Now stock market prediction is recognized as an attracting point for financial investors. The historical price is not considered as the main factor to predict stock market trend. There are many factors such as politics and natural events that affect social media environments like Twitter and Facebook that generate huge datasets and need data analysis to extract the polarity of the data and its effectiveness on the stock market. On the other hand, this data may be unstructured and may need special handling on storing and processing. This paper proposes a real time forecasting of stock market trends based on news, tweets, and historical price. A supervised machine learning algorithm is used to build this model. Historical price will have to be combined with sentiment analysis to build hybrid model based on Apache Spark and Hadoop HDFS to handle big data (structured and unstructured) generated from social media and news websites. The proposed model works on two modes; offline mode that works on historical data included today’s data after ending of stock market session and real time mode that works on real time data. This model increases the accuracy of prediction due to the additional features added by sentiment analysis on StockTwits and market news data. Additionally, the model enhances the performance of handling this data set due to parallel processing occurred on data using Apache Spark.
Subjects
Computer Science & ITEngineeringAsk about this article
Answers come only from this article's title, abstract and keywords, each sentence pointing to where it comes from. Your question is sent to OpenAI to write the answer. Scholars Central does not store it.
Similar by topic
Opinion · 20 Jan 2022
Applications of Real-Time Big Data Analytics
Conference abstract · 2022
Ensuring effectiveness of data models in real-time data analytics
Research article · 1 Dec 2021
A Novel Logistics Transportation Optimization Approach through the Detection of Road Traffic Events Using Apache Spark Big Data Framework, Machine Learning and Social Big Data
Conference abstract · 2018
Big data analytics in valuing and selecting small- and medium-capital stocks: an Indian analysis
More from this journal
The newest in Journal of Computer Engineering & Information Technology.
Review article · 27 Oct 2025
Dukan Daari Inventory Management System
Research article · 17 Jun 2025
Leveraging Information Flow Tracking for Enhanced Security in Cloud Computing
Editorial · 31 Mar 2025
Low-Code/No-Code Platforms: Democratizing Software Development
Conferences in this field
Upcoming conferences in this field.
Follow
New articles from what you follow go into your email digest, once you agree to alert emails.
- JournalJournal of Computer Engineering & Information Technology
- SubjectComputer Science & IT
- SubjectEngineering
- BylineArticles whose byline prints “Essam M Ramzy Hamed”
- BylineArticles whose byline prints “Mostafa Mohamed Seif”
- BylineArticles whose byline prints “A Hegazy”

