We present the absolute enthalpy, entropy, heat capacity, and free energy of liquid water at ambient conditions calculated by the two-phase thermodynamic method applied to ab initio, reactive and classical molecular dynamics simulations. We find that the absolute entropy and heat capacity of liquid water from ab initio molecular dynamics (AIMD) is underestimated, but falls within the range of the flexible empirical as well as the reactive force fields. The origin of the low absolute entropy of liquid water from AIMD simulations is due to an underestimation of the translational entropy by 20% and the rotational entropy by 40% compared to the TIP3P classical water model, consistent with previous studies that reports low diffusivity and increased ordering of liquid water from AIMD simulations. Classical MD simulations with rigid water models tend to be in better agreement with experiment (in particular TIP3P yielding the best agreement), although the TIP4P-ice water model, the only empirical force field that reproduces the experimental melting temperature, has the lowest entropy, perhaps expectedly. This reiterates the limitations of existing empirical water models in simultaneously capturing the thermodynamics of solid and liquid phases. We find that the quantum corrections to heat capacity of water can be as large as 60%. Although certain water models are computed to yield good absolute free energies of water compared to experiments, they are often due to the fortuitous enthalpy-entropy cancellation, but not necessarily due to the correct descriptions of enthalpy and entropy separately.