Decline in circulating sex steroid hormones accompanies several age-associated pathologies which may influence human healthspan. Mitochondria play important roles in biosynthesis of sex steroid hormones, and these hormones can also regulate mitochondrial function. Understanding the cross talk between mitochondria and sex steroid hormones may provide insights into the pathologies associated with aging. The aim of this review is to summarize the current knowledge regarding the interplay between mitochondria and sex steroid hormones during the aging process. The review describes the effect of mitochondria on sex steroid hormone production in the gonads, and then enumerates the contribution of sex steroid hormones on mitochondrial function in hormone responsive cells. Decline in sex steroid hormones and accumulation of mitochondrial damage may create a positive feedback loop that contributes to the progressive degeneration in tissue function during aging. The review further speculates whether regulation between mitochondrial function and sex steroid hormone action can potentially influence healthspan.