Commentators tend to see it as a reference to either the temple, Jerusalem, or the land in general. The majority of opinions are weighed toward the temple and toward Jerusalem. The phrase from this place
only occurs in prophetic literature, here and in Jeremiah. Each of the passages in Jeremiah is in reference to the judgment of exile, where either the people of Judah are carried from their land (Jeremiah 16:9; Jeremiah 22:11; Jeremiah 24:5) or the temple vessels are carried away from the house of the Lord (Jeremiah 28:3). Zephaniah’s word about cutting off of the remnant of Baal from this place,
then, most likely has a connection with the exile from the land—the whole land of Judah, which would include Jerusalem and the temple. This gives Zephaniah’s prophecy in Zephaniah 1:2–6 a dual reference between the final day of the Lord and a day of judgment in Judah's history.1
4 “I will stretch out my hand against Judah and against all the inhabitants of Jerusalem; and I will cut off from this place the remnant of Baal and the name of the idolatrous priests along with the priests,