Within the framework of macroscopic quantum electrodynamics, we investigate both the radiation force and the potential of Casimir-Polder type acting on an excited cold two-level atom in a cavity made of left-handed materials and topological insulators. As the time-reversal symmetry is broken on the surface of the topological insulators, the spontaneous emission of the atom placed near the focus point(s) exhibits anisotropic properties. While the potential wells are normally shallow for topological trivial dielectric, they may be amplified in the presence of topological magnetoelectric effect. We find that when there exists only one focus point in the cavity, it is possible to boost the forces or the potential wells by up to one order of magnitude. Meanwhile, the lifetime of the atom could be prolonged owing to the focus effect of the left-handed materials, where the emitted photons can trace back to the atom and reabsorbed by itself. Our results indicate the possibility in forming long-lived potential wells, which may have potential applications in trapping and guiding cold atoms far away from the surface.