Reach Us +1 850 754 6199

Journal of Computer Engineering & Information TechnologyISSN : 2324-9307

All submissions of the EM system will be redirected to Online Manuscript Submission System. Authors are requested to submit articles directly to Online Manuscript Submission System of respective journal.

Research Article, J Comput Eng Inf Technol Vol: 5 Issue: 1

Self-Organized Potential Learning: Enhancing SOM Knowledge to Train Supervised Neural Networks with Improved Interpretation and Generalization Performance

Kamimura R*
Professor of IT Education Center and School of Science and Technology of Tokai University, 4-1-1, Kitakaname Hiratsuka Kanagawa 259-1292, Japan
Corresponding author : Dr. Ryotaro Kamimura
Professor of IT Education Center and School of Science and Technology of Tokai University, 4-1-1, Kitakaname Hiratsuka Kanagawa 259-1292, Japan
Tel and Fax:
0463-58-1211
E-mail: [email protected], [email protected]
Received: February 01, 2016 Accepted: March 17, 2016 Published: March 24, 2016
Citation: Kamimura R (2016) Self-Organized Potential Learning: Enhancing SOM Knowledge to Train Supervised Neural Networks with Improved Interpretation and Generalization Performance. J Comput Eng Inf Technol 5:1. doi:10.4172/2324-9307.1000144

Abstract

Self-Organized Potential Learning: Enhancing SOM Knowledge to Train Supervised Neural Networks with Improved Interpretation and Generalization Performance

The present paper proposes a new type of learning method called “self-organized potential learning” to improve generalization and interpretation performance. In this method, the self-organizing map (SOM) is used to produce the knowledge (SOM knowledge) on input patterns. SOM knowledge is sometimes redundant and not necessarily effective in training multi-layered neural networks. The present method is introduced to focus on the most important part of the knowledge, which is extracted by considering the potentiality of neurons. For the first approximation, the potentiality is defined in terms of the variance of neurons. Then, neurons with larger potentiality are chosen as the important ones to be used in supervised learning. The method was applied to three problems, namely, artificial data, real second language leaning data and the bio-degeneracy data in the machine learning database. In all cases, it was found that in terms of variance, potentiality was effective in extracting a small number of important input and hidden neurons. Then, generalization performance was greatly improved, in particular when input and hidden neurons’ potentiality were considered with easily interpretable connection weights.

Keywords: Neural networks; Supervised learning; Self-organizing maps; Information-theoretic methods; Generalization; Interpretation

Track Your Manuscript

Share This Page