We report local spectra of the near-field thermal emission recorded by a Fourier transform infrared spectrometer, using a tungsten tip as a local scatterer coupling the near-field thermal emission to the far field. Spectra recorded on silicon carbide and silicon dioxide exhibit temporal coherence due to thermally excited surface waves. Finally, we evaluate the ability of this spectroscopy to probe the frequency dependence of the electromagnetic local density of states.