Axonemal dynein complexes are preassembled in the cytoplasm before their transport to cilia, but the mechanism of this process remains unclear. We now show that mice lacking Pih1d3, a PIH1 domain-containing protein, develop normally but manifest male sterility. Pih1d3(-/-) sperm were immotile and fragile, with the axoneme of the flagellum lacking outer dynein arms (ODAs) and inner dynein arms (IDAs) and showing a disturbed 9+2 microtubule organization. Pih1d3 was expressed specifically in spermatogenic cells, with the mRNA being most abundant in pachytene spermatocytes. Pih1d3 localized to the cytoplasm of spermatogenic cells but was not detected in spermatids or mature sperm. The levels of ODA and IDA proteins were reduced in the mutant testis and sperm, and Pih1d3 was found to interact with an intermediate chain of ODA as well as with Hsp70 and Hsp90. Our results suggest that Pih1d3 contributes to cytoplasmic preassembly of dynein complexes in spermatogenic cells by stabilizing and promoting complex formation by ODA and IDA proteins.