Ezra 4:23 (ESV)

23 Then, when the copy of King Artaxerxes’ letter was read before Rehum and Shimshai the scribe and their associates, they went in haste to the Jews at Jerusalem and by force and power made them cease.

Rehum and Shimshai are quick to implement King Artaxerxes’ decree, and they use force to make the Jews stop their work of rebuilding. They may also have burned the gates that had been constructed at that point.