The classical theory of the electrical double layer (EDL) does not consider the effects of the electrode surface structure on the EDL properties. Moreover, the best agreement between the traditional EDL theory and experiments has been achieved so far only for a very limited number of ideal systems, such as liquid metal mercury electrodes, for which it is challenging to operate with specific surface structures. In the case of solid electrodes, the predictive power of classical theory is often not acceptable for electrochemical energy applications, e.g., in supercapacitors, due to the effects of surface structure, electrode composition, and complex electrolyte contributions. In this work, we combine ab initio molecular dynamics (AIMD) simulations and electrochemical experiments to elucidate the relationship between the structure of Pt(hkl) surfaces and the double-layer capacitance as a key property of the EDL. Flat, stepped, and kinked Pt single crystal facets in contact with acidic HClO4 media are selected as our model systems. We demonstrate that introducing specific defects, such as steps, can substantially reduce the EDL capacitances close to the potential of zero charge (PZC). Our AIMD simulations reveal that different Pt facets are characterized by different net orientations of the water dipole moment at the interface. That allows us to rationalize the experimentally measured (inverse) volcano-shaped capacitance as a function of the surface step density.