Glucuronoxylans with a backbone of 1,4-linked β-D-xylosyl residues are ubiquitous in the secondary walls of gymnosperms and angiosperms. Xylans have been reported to be present in hornwort cell walls, but their structures have not been determined. In contrast, the presence of xylans in the cell walls of mosses and liverworts remains a subject of debate. Here we present data that unequivocally establishes that the cell walls of leafy tissue and axillary hair cells of the moss Physcomitrella patens contain a glucuronoxylan that is structurally similar to glucuronoxylans in the secondary cell walls of vascular plants. Some of the 1,4-linked β-D-xylopyranosyl residues in the backbone of this glucuronoxylan bear an α-D-glucosyluronic acid (GlcpA) sidechain at O-2. In contrast, the lycopodiophyte Selaginella kraussiana synthesizes a glucuronoxylan substituted with 4-O-Me-α-D-GlcpA sidechains, as do many hardwood species. The monilophyte Equisetum hyemale produces a glucuronoxylan with both 4-O-Me-α-D-GlcpA and α-D-GlcpA sidechains, as does Arabidopsis. The seedless plant glucuronoxylans contain no discernible amounts of the reducing-end sequence that is characteristic of gymnosperm and eudicot xylans. Phylogenetic studies showed that the P. patens genome contains genes with high sequence similarity to Arabidopsis CAZy family GT8, GT43 and GT47 glycosyltransferases that are likely involved in xylan synthesis. We conclude that mosses synthesize glucuronoxylan that is structurally similar to the glucuronoxylans present in the secondary cell walls of lycopodiophytes, monilophytes, and many seed-bearing plants, and that several of the glycosyltransferases required for glucuronoxylan synthesis evolved before the evolution of tracheophytes.