Proper positioning of organelles by cytoskeleton-based motor proteins underlies cellular events such as signalling, polarization and growth. For many organelles, however, the precise connection between position and function has remained unclear, because strategies to control intracellular organelle positioning with spatiotemporal precision are lacking. Here we establish optical control of intracellular transport by using light-sensitive heterodimerization to recruit specific cytoskeletal motor proteins (kinesin, dynein or myosin) to selected cargoes. We demonstrate that the motility of peroxisomes, recycling endosomes and mitochondria can be locally and repeatedly induced or stopped, allowing rapid organelle repositioning. We applied this approach in primary rat hippocampal neurons to test how local positioning of recycling endosomes contributes to axon outgrowth and found that dynein-driven removal of endosomes from axonal growth cones reversibly suppressed axon growth, whereas kinesin-driven endosome enrichment enhanced growth. Our strategy for optogenetic control of organelle positioning will be widely applicable to explore site-specific organelle functions in different model systems.