The complexity inherent in biological systems challenges efforts to rationally engineer novel phenotypes, especially those not amenable to high-throughput screens and selections. In nature, increased mutation rates generate diversity in a population that can lead to the evolution of new phenotypes. Here we construct an adaptive control system that increases the mutation rate in order to generate diversity in the population, and decreases the mutation rate as the concentration of a target metabolite increases. This system is called feedback-regulated evolution of phenotype (FREP), and is implemented with a sensor to gauge the concentration of a metabolite and an actuator to alter the mutation rate. To evolve certain novel traits that have no known natural sensors, we develop a framework to assemble synthetic transcription factors using metabolic enzymes and construct four different sensors that recognize isopentenyl diphosphate in bacteria and yeast. We verify FREP by evolving increased tyrosine and isoprenoid production.