Research article · 25 Jul 2015
Research articlePublished May 2015
Hadoop Based Parallel Framework for Feature Subset Selection in Big Data
Abstract
Select any words in the title or abstract, or press this and choose a sentence.
It is the era of Big Data. Since scale of data is increasing every minute, handling massive data becomes important in this era. Massive data poses a great challenge for classification. High dimensionality of modern massive dataset has provided a considerable challenge to clustering approaches. The curse of dimensionality can make clustering very slow, and, second, the existence of many irrelevant features may not allow the identification of the relevant underlying structure in the data. Feature selection is the most important part of the clustering process that involves identifying the set of features of a subset, at which they produce accurate and accordant results with the original set of features. Designing traditional machine learning algorithms and data mining algorithms with Map Reduce Programming is necessary in dealing with massive data sets. Map Reduce is a parallel processing framework for large datasets and Hadoop is its open-source implementation. The objective of this paper is to implement FAST clustering algorithm with Map Reduce programming to remove irrelevant and redundant features. Following preprocessing, cluster based map-reduce feature selection approach is implemented for effective outcome of features
Subjects
EngineeringAsk about this article
Answers come only from this article's title, abstract and keywords, each sentence pointing to where it comes from. Your question is sent to OpenAI to write the answer. Scholars Central does not store it.
Similar by topic
Research article · Feb 2014
An Efficient Fast Clustering-Based Feature Subset Selection Algorithm for High- Dimensional Data
Research article · Mar 2014
Big Data Intelligence in Logistics Based On Hadoop And Map Reduce
Research article · 30 Sep 2016
Accelerated PSO Swarm Search Feature Selection with SVM for Data Stream Mining Big Data
Research article · Dec 2015
ACO Swarm Search Feature Selection for Data stream Mining in Big Data
More from this journal
The newest in International Journal of Innovative Research in Science, Engineering and Technology.
Review article · 2018
Tech-Care: Personal Health Monitoring and Prediction System
Research article · 2018
Spectrum Sensing Methods for Cognitive Radio: A Survey
Review article · 2018
Utilization of Food Wastes to Prepare Film Forming Biomolecules (Retracted)
Conferences in this field
Upcoming conferences in this field.
Follow
New articles from what you follow go into your email digest, once you agree to alert emails.
- JournalInternational Journal of Innovative Research in Science, Engineering and Technology
- SubjectEngineering
- BylineArticles whose byline prints “Revathi.L”
- BylineArticles whose byline prints “A.Appandiraj”
