We report theoretical predictions and measurements of the capillary force acting on a spherical colloid smaller than the capillary length that is placed on a curved fluid interface of arbitrary shape. By coupling direct imaging and interferometry, we are able to measure the in situ colloid contact angle and to correlate its position with respect to the interface curvature. Extremely tiny capillary forces down to femtonewtons can be measured with this method. Measurements agree well with a theory relating the capillary force to the gradient of Gaussian curvature and to the mean curvature of the interface prior to colloidal deposition. Numerical calculations corroborate these results.