Job 15:22 (ESV)

22 He does not believe that he will return out of darkness, and he is marked for the sword.

The wicked know that the day of their downfall is coming. This makes them despair, even while they still seem to be prosperous.