Sample preparation is of vital importance for proteomic analysis because of the high complexity of biological samples. The rapid development of novel nanomaterials with various compositions, morphologies, and proper surface modifications provides a category of powerful tools for the sample preparation for protein analysis. In this paper, we have summarized recent progresses for the applications of novel nanomaterials in sample preparation for the analysis of proteomes, especially for phosphoproteomes, glycoproteomes, and peptidoms. Several kinds of novel nanomaterials were also discussed for their use in other kinds of proteomics analysis.