A tri-antennary Man9GlcNAc2 glycan on the surface of endoplasmic reticulum (ER) glycoproteins functions as a glycoprotein secretion or degradation signal after regioselective cleavage of the terminal α-1,2-mannose residue of each branch. Four α-1,2-mannosidases-ER mannosidase I, ER degradation-enhancing α-mannosidase-like protein 1 (EDEM1), EDEM2, and EDEM3-are involved in the production of these signal glycans. Although selective production of signal glycans is important in determining the fate of glycoproteins, the branch-discrimination abilities of the α-1,2-mannosidases are not well understood. A structural feature of the Man9GlcNAc2 glycan is that all terminal glycosidic linkages of the three branches are of the α-1,2 type, while the adjacent inner glycosidic linkages are different. In this study, we examined whether the α-1,2-mannosidases showed branch specificity by discriminating between different inner glycosides. Four trisaccharides with different glycosidic linkages [Manα1-2Manα1-2Man (natural A-branch), Manα1-2Manα1-3Man (natural B-branch), Manα1-2Manα1-6Man (natural C-branch), and Manα1-2Manα1-4Man (unnatural D-branch)] were synthesized and used to evaluate the hypothesis. When synthesizing these oligosaccharides, highly stereoselective glycosylation was achieved with a high yield in each case by adding a weak base or tuning the polarity of the mixed solvent. Enzymatic hydrolysis of the synthetic trisaccharides by a mouse liver ER fraction containing the target enzymes showed that the ER α-1,2-mannosidases had clear specificity for the trisaccharides in the order of A-branch > B-branch > C-branch ≈ D-branch. Various competitive experiments have revealed for the first time that α-1,2-mannosidase with inner glycoside specificity is present in the ER. Our findings suggest that exo-acting ER α-1,2-mannosidases can discriminate between endo-glycosidic linkages.