The Golgi apparatus is important for the transport of secretory cargo. Glycosylation is a major post-translational event. Recognition of O-glycans on proteins is necessary for glycoprotein trafficking. In this study, specific inhibition of O-glycosylation (Golgi stress) induced the expression of endoplasmic reticulum (ER)-resident heat shock protein (HSP) 47 in NIH3T3 cells, although cell death was not induced by Golgi stress alone. When HSP47 expression was downregulated by siRNA, inhibition of O-glycosylation caused cell death. Three days after the induction of Golgi stress, the Golgi apparatus was disassembled, many vacuoles appeared near the Golgi apparatus and extended into the cytoplasm, the nuclei had split, and cell death assay-positive cells appeared. Six hours after the induction of Golgi stress, HSP47-knockdown cells exhibited increased cleavage of Golgi-resident caspase-2. Furthermore, activation of mitochondrial caspase-9 and ER-resident unfolded protein response (UPR)-related molecules and efflux of cytochrome c from the mitochondria to the cytoplasm was observed in HSP47-knockdown cells 24 h after the induction of Golgi stress. These findings indicate that (i) the ER-resident chaperon HSP47 protected cells from Golgi stress, and (ii) Golgi stress-induced cell death caused by the inhibition of HSP47 expression resulted from caspase-2 activation in the Golgi apparatus, extending to the ER and mitochondria.