Brown adipose tissue (BAT) and beige fat function in energy expenditure in part due to their role in thermoregulation, making these tissues attractive targets for treating obesity and metabolic disorders. While prolonged cold exposure promotes de novo recruitment of brown adipocytes, the exact sources of cold-induced thermogenic adipocytes are not completely understood. Here, we identify transient receptor potential cation channel subfamily V member 1 (Trpv1)+ vascular smooth muscle (VSM) cells as previously unidentified thermogenic adipocyte progenitors. Single-cell RNA sequencing analysis of interscapular brown adipose depots reveals, in addition to the previously known platelet-derived growth factor receptor (Pdgfr)α-expressing mesenchymal progenitors, a population of VSM-derived adipocyte progenitor cells (VSM-APC) expressing the temperature-sensitive cation channel Trpv1. We demonstrate that cold exposure induces the proliferation of Trpv1+ VSM-APCs and enahnces their differentiation to highly thermogenic adipocytes. Together, these findings illustrate the landscape of the thermogenic adipose niche at single-cell resolution and identify a new cellular origin for the development of brown and beige adipocytes.