Recently, we reported potent substrate-based pentapeptidic BACE1 inhibitors possessing a hydroxymethylcarbonyl isostere as a substrate transition-state mimic. Because these inhibitors contained some natural amino acids, we would need to improve their enzymatic stability in vivo and permeability across the blood-brain barrier, so that they become practically useful. Subsequently, non-peptidic and small-sized BACE1 inhibitors possessing a heterocyclic scaffold, 2,6-pyridenedicarboxylic, chelidamic or chelidonic moiety, at the P(2) position were reported. These inhibitors were designed based on the conformer of docked inhibitor in BACE1. In this study, we discuss the role and significance of interactions between Arg235 of BACE1 and its inhibitor in BACE1 inhibitory mechanism. Moreover, we designed more potent small-sized BACE1 inhibitors with a 2,6-pyridinedicarboxylic scaffold at the P(2) position, that were optimized for the interactions with Arg235 of BACE1.