Scholars Central

Research articlePublished Mar 2014

PMI Based Clustering Algorithm for Feature Reduction in Text Classification

Authors: P.Jeyadurga, Prof. P. R. Vijaya Lakshmi, J.S.Kanchana

Ask about this article

Abstract

Select any words in the title or abstract, or press this and choose a sentence.

Feature clustering is a feature reduction method that reduces the dimensionality of feature vectors for text classification. In this paper an incremental feature clustering approach is proposed that uses Semantic similarity to cluster the features. Pointwise Mutual Information (PMI) is widely used word similarity measure, which finds Semantic similarity between two words and is an alternative for distributional similarity. PMI computation requires simple statistics about two words for similarity measure, that is number of cooccurrences or correlations between two concepts of fixed size are computed. Once the words from preprocessed documents are fed, clusters are formed and one feature (head word) is identified for each cluster which are used for indexing the document. PMI assumes that a word have single sense, but clustering can be optimized further if polysemies of words are considered. Hence PMI may be combined with PMImax, which estimates correlation between the closest senses of two words also, thereby better feature reduction and execution time compared with other approaches.

Subjects

Engineering

Ask about this article

Answers come only from this article's title, abstract and keywords, each sentence pointing to where it comes from. Your question is sent to OpenAI to write the answer. Scholars Central does not store it.

Try:

Similar by topic

More from this journal

The newest in International Journal of Innovative Research in Science, Engineering and Technology.

All its articles

Conferences in this field

Upcoming conferences in this field.

Follow

New articles from what you follow go into your email digest, once you agree to alert emails.

  • JournalInternational Journal of Innovative Research in Science, Engineering and Technology
  • SubjectEngineering
  • BylineArticles whose byline prints “P.Jeyadurga”
  • BylineArticles whose byline prints “Prof. P. R. Vijaya Lakshmi”
  • BylineArticles whose byline prints “J.S.Kanchana”

For authors and organisers

Publish, present and keep up with your field

Find the right journal for your paper and submit your manuscript.

Photo: Pexels