The advent of non-invasive functional brain imaging has clarified which regions of the brain are recruited during sexual arousal. Injuries to those regions, and to the spinal cord and peripheral nerves that link genitalia to limbic and cognitive centres, can profoundly influence sexual wellbeing. In epilepsy, expressions of hypersexuality and hyposexuality interact with the location of epileptogenic foci in the temporolimbic circuitry, and are tempered by the sexual effects of drug treatments. We outline the sexual consequences of epilepsy, stroke, multiple sclerosis, Parkinson's disease, and other common neurological disorders. Management of sexual dysfunction from both disease and treatment is discussed. Nerve-sparing techniques could mitigate the substantial sexual dysfunction in both men and women through surgical disruption of the autonomic nerves during radical pelvic surgery.