The Benjamites lost 18,000 in the initial conflict, when the Israelites turned around attacked their pursuers. Of all who fell that day (which Judges 20:46 says was 25,000), only a third of them managed to break from this initial clash and make for the desert.
44 Eighteen thousand men of Benjamin fell, all of them men of valor.