In this work, nanocomposites made of nanosized zirconia crystallized in situ in an amorphous silicon oxycarbo(nitride) (SiOC(N)) matrix have been designed through a precursor route for visible light photocatalytic applications. The relative volume fraction of the starting precursors and the pyrolysis temperatures not only influences the phase fraction of zirconia crystallites but also stabilizes the tetragonal crystal structure of zirconia (t-ZrO2) at room temperature. The presence of carbon in interstitial sites of zirconia and oxygen vacancy defects led to drastic reduction in the band gap (2.2 eV) of the nanocomposite. Apart from being a perfect host avoiding sintering of the active phase and providing mechanical stability, the amorphous matrix also reduces the recombination rate by forming heterojunctions with t-ZrO2. The reduction in band gap as well as the formation of heterojunctions aids in harnessing the visible light for photocatalytic activity.