The world health organization (WHO) estimated that 18 million people are struck by Alzheimer's disease (AD). The USA, France, Germany, and other countries launched major programmes targeting the identification of risk factors, the improvement of caretaking, and fundamental research aiming to postpone the onset of AD. The glycogen synthase kinase 3 (GSK-3) is implicated in multiple cellular processes and has been linked to the pathogenesis of several diseases including diabetes mellitus, cancer, and AD. Inhibition of GSK-3 leads to neuroprotective effects, decreased β-amyloid production, and a reduction in tau hyperphosphorylation, which are all associated with AD. Various classes of small molecule GSK-3 inhibitors have been published in patents and original publications. Herein, we present a comprehensive summary of small molecules reported to interact with GSK-3. We illustrate the interactions of the inhibitors with the active site. Furthermore, we refer to the biological characterisation in terms of activity and selectivity for GSK-3, elucidate in vivo studies and pre-/clinical trials.