Epidermal structures are different among body sites, and proliferative keratinocytes in the epidermis play an important role in the maintenance of the epidermal structures. In recent years, intravital skin imaging has been used in mammalian skin research for the investigation of cell behaviors, but most of these experiments were performed with rodent ears. Here, we established a non-invasive intravital imaging approach for dorsal, ear, hind paw, or tail skin using R26H2BEGFP hairless mice. Using four-dimensional (x, y, z, and time) imaging, we successfully visualized mitotic cell division in epidermal basal cells. A comparison of cell division orientation relative to the basement membrane in each body site revealed that most divisions in dorsal and ear epidermis occurred in parallel, whereas the cell divisions in hind paw and tail epidermis occurred both in parallel and oblique orientations. Based on the quantitative analysis of the four-dimensional images, we showed that the epidermal thickness correlated with the basal cell density and the rate of the oblique divisions.