A novel optical antenna with an off-axis confocal parabolic rotating surfaces configuration is designed for achieving maximum transmission efficiency. An improved 3-D ray tracing method based on the vector theory of reflection is used to simulate spatial rays transmitting through the antenna system. Aberrations and the spatial divergence angles of the output beam, which are caused by on-axial defocusing and off-axial defocusing between the primary reflector and secondary reflector, are visualized and effects on receiver efficiency of the antenna system are analyzed in detail. This work will provide a reference for improving the transmission efficiency of long-range communication systems.