Efficient coding theory proposes that sensory systems in the brain have been adapted to process natural scenes efficiently over the long history of evolution. Computational modeling the statistical regularities of natural images is therefore beneficial to our understanding of the mechanisms of visual information processing. In this paper, we briefly review the recent progress in using efficient coding approaches to study the encoding of natural images in the visual system.