A semiclassical quasistatic model is used to investigate the recollision dynamics in circularly polarized laser fields. A velocity window for recollision to occur is found. Only when the return electron's orbits are irregular does significant double ionization take place. The model reproduces the experimental results for magnesium and explains the apparently conflicting experimental results in terms of an analytical formula that demarcates the phase diagram for the nonsequential double ionization in circularly polarized laser fields.