Coherent longitudinal lattice vibrations of black phosphorus provide unique access to the out-of-plane strain coupled in-plane optical properties. In this work, polarization-resolved femtosecond transient absorption microscopy is applied to study the anisotropic coherent phonon responses. Multiorder phonon harmonics were observed with thickness dependence well explained by the linear chain model, allowing rapid optical mapping of phonon frequency distributions. More interestingly, exotic coherent phonon oscillations occourred with a π-phase jump between the armchair and zigzag polarizations, which reveals opposite signs of photoelasticity under the longitudinal strain. Specifically, compressive strain reduces the imaginary refractive index in the armchair polarization but increases the real refractive index in the zigzag polarization, as confirmed by the ab initio calculations and thin film model. These fundamental properties of black phosphorus hold potential for applications in ultrafast and polarization-sensitive photoacoustic/photoelastic modulators.