Increasing evidence indicates that sarcopenia and obesity can be risk factors for incident dementia. We investigated the association of body composition including muscle and visceral adipose tissue (VAT) with the probability of Alzheimer's disease (AD) in healthy middle-aged and elderly subjects using 18F-fluorodeoxyglucose (FDG) positron emission tomography (PET)/computed tomography (CT). This study included 110 healthy subjects with available whole-body FDG PET/CT scans and medical records. Muscle and VAT tissues were measured on the abdominal CT slice, and the PMOD Alzheimer's discrimination FDG PET analysis tool (PALZ) score was evaluated on the brain PET of the same subject using software PALZ. Skeletal muscle index (r: -0.306; P = 0.031) was significantly negatively associated with the PALZ score in the elderly patients. Muscle area (β: -0.640; P = 0.043) and skeletal muscle index (β: -0.557; P = 0.043) were independently associated with the PALZ score in elderly subjects after adjustments for sex, duration of education, hypertension, diabetes mellitus, and smoking and drinking status. Increased muscle tissue was associated with a lower probability of AD in elderly subjects, but VAT was not associated with a lower probability of AD in middle-or older-aged adults.