Scholars Central

Research articlePublished 24 Mar 2016

Self-Organized Potential Learning: Enhancing SOM Knowledge to Train Supervised Neural Networks with Improved Interpretation and Generalization Performance

Authors: Ryotaro Kamimura

Ask about this article

Abstract

Select any words in the title or abstract, or press this and choose a sentence.

The present paper proposes a new type of learning method called “self-organized potential learning” to improve generalization and interpretation performance. In this method, the self-organizing map (SOM) is used to produce the knowledge (SOM knowledge) on input patterns. SOM knowledge is sometimes redundant and not necessarily effective in training multi-layered neural networks. The present method is introduced to focus on the most important part of the knowledge, which is extracted by considering the potentiality of neurons. For the first approximation, the potentiality is defined in terms of the variance of neurons. Then, neurons with larger potentiality are chosen as the important ones to be used in supervised learning. The method was applied to three problems, namely, artificial data, real second language leaning data and the bio-degeneracy data in the machine learning database. In all cases, it was found that in terms of variance, potentiality was effective in extracting a small number of important input and hidden neurons. Then, generalization performance was greatly improved, in particular when input and hidden neurons’ potentiality were considered with easily interpretable connection weights.

Ask about this article

Answers come only from this article's title, abstract and keywords, each sentence pointing to where it comes from. Your question is sent to OpenAI to write the answer. Scholars Central does not store it.

Try:

More from this journal

The newest in Journal of Computer Engineering & Information Technology.

All its articles

Conferences in this field

Upcoming conferences in this field.

Follow

New articles from what you follow go into your email digest, once you agree to alert emails.

  • JournalJournal of Computer Engineering & Information Technology
  • SubjectComputer Science & IT
  • SubjectEngineering
  • BylineArticles whose byline prints “Ryotaro Kamimura”

For authors and organisers

Publish, present and keep up with your field

Find the right journal for your paper and submit your manuscript.

Photo: Pexels