A recurrent model of transformation invariance by association

Neural Netw. 2000 Mar;13(2):225-37. doi: 10.1016/s0893-6080(99)00096-9.


This paper describes an investigation of a recurrent artificial neural network which uses association to build transform-invariant representations. The simulation implements the analytic model of Parga and Rolls [(1998). Transform-invariant recognition by association in a recurrent network. Neural Computation 10(6), 1507-1525.] which defines multiple (e.g. "view") patterns to be within the basin of attraction of a shared (e.g. "object") representation. First, it was shown that the network could store and correctly retrieve an "object" representation from any one of the views which define that object, with capacity as predicted analytically. Second, new results extended the analysis by showing that correct object retrieval could occur where retrieval cues were distorted; where there was some association between the views of different objects; and where connectivity was diluted, even when this dilution was asymmetric. The simulations also extended the analysis by showing that the system could work well with sparse patterns; and showing how pattern sparseness interacts with the number of views of each object (as a result of the statistical properties of the pattern coding) to give predictable object retrieval performance. The results thus usefully extend a recurrent model of invariant pattern recognition.

MeSH terms

  • Artificial Intelligence*
  • Models, Neurological*
  • Neural Networks, Computer*