Mycorrhizal symbiosis between soil fungi and land plants is one of the most widespread and ecologically important mutualisms on earth. It has long been hypothesized that the Glomeromycotina, the mycorrhizal symbionts of the majority of plants, facilitated colonization of land by plants in the Ordovician. This view was recently challenged by the discovery of mycorrhiza-like associations with Mucoromycotina in several early diverging lineages of land plants. Utilizing a large, species-level database of plants' mycorrhiza-like associations and a Bayesian approach to state transition dynamics we here show that the recruitment of Mucoromycotina is the best supported transition from a non-mycorrhizal state. We further found that transitions between different combinations of either or both of Mucoromycotina and Glomeromycotina occur at high rates, and found similar promiscuity among combinations that include either or both of Glomeromycotina and Ascomycota with a nearly fixed association with Basidiomycota. Our results portray an evolutionary scenario of evolution of mycorrhizal symbiosis with a prominent role for Mucoromycotina in the early stages of land plant diversification.