X-ray Talbot interferometry is attractive as a method for X-ray phase imaging and phase tomography for objects that weakly absorb X-rays. Because X-ray Talbot interferometry has the advantage that X-rays of a broad energy bandwidth can be used, high-speed X-ray phase imaging is possible with white synchrotron radiation. In this paper, we demonstrate time-resolved three-dimensional observation with X-ray Talbot interferometry (namely, four-dimensional X-ray phase tomography). Differential phase images, from which a phase tomogram was reconstructed, were obtained through the Fourier-transform method, unlike the phase-stepping method that requires several (at least three) moiré images to be measured sequentially in order to generate one differential phase image. We demonstrate dynamic observation of a living worm in three dimensions with a time resolution of 0.5 s, visualizing a drastic change in the respiratory tract.