The structure of sulphostin (1), a novel dipeptidyl peptidase IV (DPP-IV) inhibitor, is consisted of three key functional groups, including a characteristic amino(sulfoamino)phosphinyl group, on a piperidine ring. To examine the relationship between its structure and the inhibitory activity against DPP-IV, various analogues were synthesized and their activities were investigated. These results indicated that all of the functional groups on the piperidine ring were crucial to the DPP-IV inhibitory activity of sulphostin, and that the sulfonic acid group, which constructed the amino(sulfoamino)phosphinyl group, contributed to the stability of the compound. Moreover, those functional groups should be adjoined on the piperidine ring for the inhibitory activity. The size of the nitrogen-containing heterocyclic ring including piperidine appeared to scarcely affect the activity. In the present study, the sulfonic acid-deficient five-membered ring analogue 27a showed the strongest inhibitory activity (IC50=11 nM).