Jesus foretold the coming destruction of the temple (Luke 21:5–9) and also spoke of his body in reference to the temple (John 2:19–21). He did not claim that he would destroy the temple. It appears as if the Jews remembered something of the words spoken by Jesus when he visited Jerusalem in the past (John 2:13–22). Sadly, they misunderstood what Jesus said and were now claiming that he and his followers wanted to destroy the temple.
14 for we have heard him say that this Jesus of Nazareth will destroy this place and will change the customs that Moses delivered to us.”