Polyglutamine (polyQ) stretch amplification in different proteins causes neurodegenerative disease. These proteins form intracellular aggregates thought to be cytotoxic but differ in pathology and tissue specificity. Here, we demonstrate that specific sequences outside the polyQ stretch of the human androgen receptor contribute to polyQ pathology. An exchange of two N-terminal serine phosphorylation residues to alanine in the wild type androgen receptor (ARQ22dm) resulted in cytoplasmic accumulation and increased early hormone-dependent aggregation of the receptor. In a Drosophila model, the ARQ22dm was cytotoxic, and developing larvae expressing this receptor showed behavioral abnormalities and severely impaired locomotion. In contrast, the same double mutation in an androgen receptor with an extended polyQ stretch was less toxic. The response of the receptors to inhibitors of polyglutamine toxicity is altered by the amino acid exchanges suggesting that careful consideration is needed in the choice of potential therapies of disorders involving toxic polyQ species.