AMP binding sites are commonly used by nature for allosteric regulation of enzymes controlling the production and metabolism of carbohydrates and lipids. Since many of these enzymes represent potential drug targets for metabolic diseases, efforts were initiated to discover AMP mimics that bind to AMP-binding sites with high affinity and high enzyme specificity. Herein we report the structure-guided design of potent fructose 1,6-bisphosphatase (FBPase) inhibitors that interact with the AMP binding site on FBPase despite their structural dissimilarity to AMP. Molecular modeling, free-energy perturbation calculations, X-ray crystallography, and enzyme kinetic data guided our redesign of AMP, which began by replacing the 5'-phosphate with a phosphonic acid attached to C8 of the adenine base via a 3-atom spacer. Additional binding affinity was gained by replacing the ribose with an alkyl group that formed van der Waals interactions with a hydrophobic region within the AMP binding site and by replacing the purine nitrogens N1 and N3 with carbons to minimize desolvation energy expenditures. The resulting benzimidazole phosphonic acid, 16, inhibited human FBPase (IC50 = 90 nM) 11-fold more potently than AMP and exhibited high specificity for the AMP binding site on FBPase. 16 also inhibited FBPase in primary rat hepatocytes and correspondingly resulted in concentration-dependent inhibition of the gluconeogenesis pathway. Accordingly, these results suggest that the AMP site of FBPase may represent a potential drug target for reducing the excessive glucose produced by the gluconeogenesis pathway in patients with type 2 diabetes.