The estimation of the bathymetry and the detection of targets located on the seabed of shallow waters using remote sensing techniques is of great interest for many environmental applications in coastal areas such as benthic habitat mapping, monitoring of seabed aquatic plants and the subsequent management of littoral zones. For that purpose, knowledge of the optical effects induced by the neighborhood of a given seabed target and by the water column itself is required to better interpret the subsurface upward radiance measured by satellite or shipborne radiometers. In this paper, the various sources of photons that contribute to the subsurface upward radiance are analyzed. In particular, the adjacency effects caused by the neighborhood of a given seabed target are quantified for three water turbidity conditions, namely clear, moderately turbid and turbid waters. Firstly, an analytical expression of the subsurface radiance is proposed in order to make explicit the radiance terms corresponding to these effects. Secondly, a sensitivity study is performed using radiative transfer modeling to determine the influence of the seabed adjacency effects on the upward signal with respect to various parameters such as the bathymetry or the bottom brightness. The results show that the highest contributions of the adjacency effects induced by the neighborhood of a seabed target to the subsurface radiance could reach 26%, 18% and 9% for clear, moderately turbid and turbid water conditions respectively. Therefore, the detection of a seabed target could be significantly biased if the seabed adjacency effects are ignored in the analysis of remote sensing measurements. Our results could be further used to improve the performance of inverse algorithms dedicated to the retrieval of bottom composition, water optical properties and/or bathymetry.