Thou shalt make no covenant with them. See below, Exodus 34:12-15. According to the forms usual at the time, a treaty of peace would have contained an acknowledgment of the gods of either nation, and words in honour of them.
This would have been equivalent to "making a covenant with their gods."