The use of any optical material is limited at high fluences by laser-induced damage to optical surfaces. In many optical materials, the damage results from a series of sources which initiate at a large range of fluences and intensities. Much progress has been made recently eliminating silica surface damage due to fracture-related precursors at relatively low fluences (i.e., less than 10 J/cm(2), when damaged by 355 nm, 5 ns pulses). At higher fluence, most materials are limited by other classes of damage precursors which exhibit a strong threshold behavior and high areal density (>10(5) cm(-2)); we refer to these collectively as high fluence precursors. Here, we show that a variety of nominally transparent materials in trace quantities can act as surface damage precursors. We show that by minimizing the presence of precipitates during chemical processing, we can reduce damage density in silica at high fluence by more than 100 times while shifting the fluence onset of observable damage by about 7 J/cm(2). A better understanding of the complex chemistry and physics of cleaning, rinsing, and drying will likely lead to even further improvements in the damage performance of silica and potentially other optical materials.