Deuteronomy 2:21 (ESV)

21 a people great and many, and tall as the Anakim; but the LORD destroyed them before the Ammonites, and they dispossessed them and settled in their place,

It was the Lord himself who drove out the ancient giant inhabitants in favour of the Ammonites.