Biphasic effects of cannabinoids have been shown in processes such as feeding behavior, motor activity, motivational processes and anxiety responses. Using two different tests for the characterization of anxiety-related behavior (elevated plus-maze and holeboard), we first identified in wild-type C57BL/6N mice, two doses of the synthetic CB1 cannabinoid receptor agonist CP-55,940 with anxiolytic (1 μg/kg) and anxiogenic properties (50 μg/kg), respectively. To clarify the role of CB1 receptors in this biphasic effect, both doses were applied to two different conditional CB1 receptor knockout (KO) mouse lines, GABA-CB1-KO (CB1 receptor inactivation in forebrain GABAergic neurons) and Glu-CB1-KO (CB1 receptor inactivation in cortical glutamatergic neurons). We found that the anxiolytic-like effects of the low dose of cannabinoids are mediated via the CB1 receptor on cortical glutamatergic terminals, because this anxiolytic-like response was abrogated only in Glu-CB1-KO mice. On the contrary, the CB1 receptor on the GABAergic terminals is required to induce an anxiogenic-like effect under a high-dose treatment because of the fact that this effect was abolished specifically in GABA-CB1-KO mice. These experiments were carried out in both sexes, and no differences occurred with the doses tested in the mutant mice. Interestingly, the positive allosteric modulation of GABA(B) receptor with GS-39783 was found to largely abrogate the anxiogenic-like effect of the high dose of CP-55,940. Our results shed new light in further understanding the biphasic effects of cannabinoids at the molecular level and, importantly, pave the way for the development of novel anxiolytic cannabinoid drugs, which may have favorable effect profiles targeting the CB1 receptor on glutamatergic terminals.