The dominated hole transport material (HTM) used in state-of-the-art perovskite solar cells (PSCs) is Spiro-OMeTAD, which needs to be doped to improve its conductivity and mobility. The inevitable instability induced by deliquescent dopants and the necessary oxidation process in air hinders the commercialization of this technology. Here, an alloy strategy using two conjugated polymers with highly similar structures but different crystallinities for dopant-free HTM and high-performance PSCs has been demonstrated. We found that the polymeric packing and crystallinity of a polymer alloy could be regulated finely by blending the polymer PM6 and our developed polymer PMSe, which exhibits a shorter π-π stacking distance due to the improved planarity of the polymer backbone with strong C═O···Se noncovalent interactions. The structure-property relationship of the polymer alloy is investigated by theoretical and experimental analyses. The optimized PSCs using the polymer alloy HTM without any ionic dopants feature an excellent power conversion efficiency of 24.53% and a high open circuit voltage (VOC) of 1.19 V with much improved stability. This efficiency is much higher than that of the control device using doped Spiro-OMeTAD HTM (PCE = 22.54%). Our work provides a very effective strategy to design and construct dopant-free hole transport materials for highly efficient perovskite solar cells and other applications.