The speed of image processing is limited by image acquisition circuitry. While optical pattern recognition techniques can reduce the computational burden on digital image processing, their image correlation rates are typically low due to the use of spatial optical elements. Here we report a method that overcomes this limitation and enables fast real-time analog image recognition at a record correlation rate of 36.7 MHz--1000 times higher rates than conventional methods. This technique seamlessly performs image acquisition, correlation, and signal integration all optically in the time domain before analog-to-digital conversion by virtue of optical space-to-time mapping.