Src homology 2 (SH2) domains are the largest family of interaction modules encoded by the human genome to recognize tyrosine-phosphorylated sequences and thereby play pivotal roles in transducing and controlling cellular signals emanating from protein-tyrosine kinases. Different SH2 domains select for distinct phosphopeptides, and the function of a given SH2 domain is often dictated by the specific motifs that it recognizes. Therefore, deciphering the phosphotyrosyl peptide motif recognized by an SH2 domain is the key to understanding its cellular function. Here we cloned all 120 SH2 domains identified in the human genome and determined the phosphotyrosyl peptide binding properties of 76 SH2 domains by screening an oriented peptide array library. Of these 76, we defined the selectivity for 43 SH2 domains and refined the binding motifs for another 33 SH2 domains. We identified a number of novel binding motifs, which are exemplified by the BRDG1 SH2 domain that selects specifically for a bulky, hydrophobic residue at P + 4 relative to the Tyr(P) residue. Based on the oriented peptide array library data, we developed scoring matrix-assisted ligand identification (or SMALI), a Web-based program for predicting binding partners for SH2-containing proteins. When applied to SH2D1A/SAP (SLAM-associated protein), a protein whose mutation or deletion underlies the X-linked lymphoproliferative syndrome, SMALI not only recapitulated known interactions but also identified a number of novel interacting proteins for this disease-associated protein. SMALI also identified a number of potential interactors for BRDG1, a protein whose function is largely unknown. Peptide in-solution binding analysis demonstrated that a SMALI score correlates well with the binding energy of a peptide to a given SH2 domain. The definition of the specificity space of the human SH2 domain provides both the necessary molecular basis and a platform for future exploration of the functions for SH2-containing proteins in cells.