Using molecular dynamics simulations and scaling analysis, we study the effect of the solvent quality for the polymer backbone, the strength of the electrostatic interactions, the chain degree of polymerization, and the brush grafting density on conformations of the planar polyelectrolyte brushes in salt-free solutions. Polyelectrolyte brush forms: (1) vertically oriented cylindrical aggregates (bundles of chains), (2) maze-like aggregate structures, or (3) thin polymeric layer covering a substrate. These different brush morphologies appear as a result of the fine interplay between electrostatic and short-range monomer-monomer interactions. The brush thickness shows nonmonotonic dependence on the value of the Bjerrum length. It first increases with the increasing value of the Bjerrum length, and then it begins to decrease. This behavior is a result of counterion condensation within a brush volume.