For optical wireless communication systems, mechanical beam steering struggles to timely switch between multiple users or search for moving users. Here we demonstrate a fast-beam-switching optical phased array (OPA) for agile wireless communication networks. For point-to-multi-point (P2MP) scenarios, a setup of OPA-based fast beam switching between two aligned receivers was developed. A loss-free image transmission experiment was used to demonstrate the stability of switching. Furthermore, we have developed an approach to using the fast-switching OPA to follow the trajectory of moving objects so as to help enable agile random-access switching between moving objects. These results could help offer fast switching and reconfiguration for indoor wireless optical communications.