Simple neuron models for independent component analysis

Int J Neural Syst. 1996 Dec;7(6):671-87. doi: 10.1142/s0129065796000646.

Abstract

Recently, several neural algorithms have been introduced for Independent component Analysis. Here we approach the problem from the point of view of a single neuron. First, simple Hebbian-like learning rules are introduced for estimating one of the independent components from sphered data. Some of the learning rules can be used to estimate an independent components which has a negative kurtosis, and the others estimate a component of positive kurtosis. Next, a two-unit system is introduced to estimate an independent component of any kurtosis. The results are then generalized to estimate independent components from non-sphered (raw) mixtures. To separate several independent components, a system of several neurons with linear negative feedback is used. The convergence of the learning rules is rigorously proven without any unnecessary hypotheses on the distribution of the independent components.

MeSH terms

  • Algorithms
  • Artificial Intelligence
  • Models, Neurological*
  • Models, Statistical
  • Neural Networks, Computer*
  • Neurons / physiology*