Most invasive breast cancers are classified as invasive ductal carcinoma not otherwise specified (IDC NOS), whereas about 25% are defined as histological 'special types'. These special-type breast cancers are categorized into at least 17 discrete pathological entities; however, whether these also constitute discrete molecular entities remains to be determined. Current therapy decision-making is increasingly governed by the molecular classification of breast cancer (luminal, basal-like, HER2+). The molecular classification is derived from mainly IDC NOS and it is unknown whether this classification applies to all histological subtypes. We aimed to refine the breast cancer classification systems by analysing a series of 11 histological special types [invasive lobular carcinoma (ILC), tubular, mucinous A, mucinous B, neuroendocrine, apocrine, IDC with osteoclastic giant cells, micropapillary, adenoid cystic, metaplastic, and medullary carcinoma] using immunohistochemistry and genome-wide gene expression profiling. Hierarchical clustering analysis confirmed that some histological special types constitute discrete entities, such as micropapillary carcinoma, but also revealed that others, including tubular and lobular carcinoma, are very similar at the transcriptome level. When classified by expression profiling, IDC NOS and ILC contain all molecular breast cancer types (ie luminal, basal-like, HER2+), whereas histological special-type cancers, apart from apocrine carcinoma, are homogeneous and only belong to one molecular subtype. Our analysis also revealed that some special types associated with a good prognosis, such as medullary and adenoid cystic carcinomas, display a poor prognosis basal-like transcriptome, providing strong circumstantial evidence that basal-like cancers constitute a heterogeneous group. Taken together, our results imply that the correct classification of breast cancers of special histological type will allow a more accurate prognostication of breast cancer patients and facilitate the identification of optimal therapeutic strategies.