The nuclear envelope in eukaryotic cells has important roles in chromatin organization. The inner nuclear membrane contains over 60 transmembrane proteins. LEM [LAP2 (lamina-associated polypeptide 2)/emerin/MAN1] domain-containing proteins of the inner nuclear membrane are involved in tethering chromatin to the nuclear envelope and affect gene expression. They contain a common structural, bihelical motif, the so-called LEM domain, which mediates binding to a conserved chromatin protein, BAF (barrier to autointegration factor). Interestingly, this domain is highly related to other bihelical motifs, termed HeH (helix-extension-helix) and SAP {SAF (scaffold attachment factor)/acinus/PIAS [protein inhibitor of activated STAT (signal transducer and activator of transcription)]} motifs, which are directly linked to DNA. In the present paper, we summarize evidence that the LEM motif evolved from the HeH and SAP domains concomitantly with BAF. In addition, we discuss the potential evolution of HeH/SAP and LEM domain-containing proteins and their role in chromatin tethering and gene regulation from unicellular eukaryotes to mammals.