Materials with an extreme lattice thermal conductivity (κl) are indispensable for thermal energy management applications. Layered materials provide an avenue for designing such functional materials due to their intrinsic bonding heterogeneity. Therefore, a microscopic understanding of the crystal structure, bonding, anharmonic lattice dynamics, and phonon transport properties is critically important for layered materials. Alkaline-earth halofluorides exhibit anisotropy from their layered crystal structure, which is strongly determined by axial bond(s), and it is attributed to the large axial ratio (c/a > 2) for CaBrF, CaIF, and SrIF, in which Br/I acts as a rattler, as evidenced from potential energy curves and phonon density of states. The low axial (c/a) ratio leads to relatively isotropic κl values in the BaXF (X = Cl, Br, I) series. MXF (M = Ca, Sr, Ba) compounds exhibit highly anisotropic (a large phonon transport anisotropy ratio of 10.95 for CaIF) to isotropic (a small phonon transport anisotropy ratio of 1.49 for BaBrF) κl values despite their iso-structure. Moreover, ultralow κl (<1 W/m K) values have been predicted for CaBrF, CaIF, and SrIF in the out-of-plane direction due to weak van der Waals (vdWs) bonding. Overall, this comprehensive study on MXF compounds provides insights into designing low κl layered materials with a large axial ratio by fine-tuning out-of-plane bonding from ionic to vdWs bonding.