A recent publication [Phys. Rev. Lett. 92, 020404 (2004)] raises the possibility of momentum transfer from zero-point quantum fluctuations to matter, controlled by applied electric and magnetic fields. We present a Lorentz-invariant description using field-theoretical regularization techniques. We find no momentum transfer for homogeneous media, but predict a very small transfer for a Casimir-type geometry.