An end-to-end image reproduction method is proposed to render cultural heritage images under arbitrary illuminating conditions. When displayed on a characterized display, the appearance of paper-based cultural heritages is reproduced as actually observed under the target illumination, by leveraging spectral images of the artworks and spectral power distribution (SPD) of the identical illumination. Psychophysical experiments are conducted to verify that the proposed method outperforms the traditional pipelines on reproducing real scenes, including the CIECAM02 color appearance model. The method has the potential to be applied in the digitization and exhibition of paper cultural heritages.