The potential leaching of pollutants present in harbor sediments has to be evaluated in order to choose the best practices for managing them. Little is known about the speciation and mobility of heavy metals in these specific solid materials. The objective of this paper is to determine and model the leachability of copper, lead, and zinc present in harbor sediments in order to obtain essential new data. The mobility of inorganic contaminants in a polluted harbor sediment collected in France was investigated as a function of physicochemical conditions. The investigation relied mainly on the use of leaching tests performed in combination with mineralogical analysis and thermodynamic modeling using PHREEQC. The modeling phase was dedicated to both confirm the hypothesis formulated to explain the experimental results and improve the determination of the main physico-chemical parameters governing mobility. The experimental results and modeling showed that the release of copper, lead, and zinc is very low with deionized water which is due to the stability of the associated solid phases (organic matter, carbonate minerals, and/or iron sulfides) at natural slightly basic conditions. However, increased mobilization is observed under pH values below 6.0 and above 10.0. This methodology helped to consistently obtain the geochemical parameters governing the mobility of the contaminants studied.