Skip to main page content
Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
, 37 (23), 3311-25

Sparse Coding With an Overcomplete Basis Set: A Strategy Employed by V1?


Sparse Coding With an Overcomplete Basis Set: A Strategy Employed by V1?

B A Olshausen et al. Vision Res.


The spatial receptive fields of simple cells in mammalian striate cortex have been reasonably well described physiologically and can be characterized as being localized, oriented, and bandpass, comparable with the basis functions of wavelet transforms. Previously, we have shown that these receptive field properties may be accounted for in terms of a strategy for producing a sparse distribution of output activity in response to natural images. Here, in addition to describing this work in a more expansive fashion, we examine the neurobiological implications of sparse coding. Of particular interest is the case when the code is overcomplete--i.e., when the number of code elements is greater than the effective dimensionality of the input space. Because the basis functions are non-orthogonal and not linearly independent of each other, sparsifying the code will recruit only those basis functions necessary for representing a given input, and so the input-output function will deviate from being purely linear. These deviations from linearity provide a potential explanation for the weak forms of non-linearity observed in the response properties of cortical simple cells, and they further make predictions about the expected interactions among units in response to naturalistic stimuli.

Similar articles

See all similar articles

Cited by 177 PubMed Central articles

  • Learning to See Stuff
    RW Fleming et al. Curr Opin Behav Sci 30, 100-108. PMID 31886321. - Review
    Materials with complex appearances, like textiles and foodstuffs, pose challenges for conventional theories of vision. But recent advances in unsupervised deep learning p …
  • An Adaptive Homeostatic Algorithm for the Unsupervised Learning of Visual Features
    LU Perrinet. Vision (Basel) 3 (3). PMID 31735848.
    The formation of structure in the visual system, that is, of the connections between cells within neural populations, is by and large an unsupervised learning process. In …
  • A Systematic Review of Detecting Sleep Apnea Using Deep Learning
    SS Mostafa et al. Sensors (Basel) 19 (22). PMID 31726771. - Review
    Sleep apnea is a sleep related disorder that significantly affects the population. Polysomnography, the gold standard, is expensive, inaccessible, uncomfortable and an ex …
  • The Statistics of How Natural Images Drive the Responses of Neurons
    A Iyer et al. J Vis 19 (13), 4. PMID 31689717.
    To model the responses of neurons in the early visual system, at least three basic components are required: a receptive field, a normalization term, and a specification o …
  • The Geometry of Masking in Neural Populations
    DL Ringach. Nat Commun 10 (1), 4879. PMID 31653855.
    The normalization model provides an elegant account of contextual modulation in individual neurons of primary visual cortex. Understanding the implications of normalizati …
See all "Cited by" articles

Publication types

LinkOut - more resources