The sword, which ye feared; rather, which ye fear. The calamities mentioned were precisely these of which the Jews were apprehensive in their own country. So afterwards, "whereof ye are afraid." Shall overtake you there.
For a further explanation, see Jeremiah 43:8-13.