Why did Jesus use a whip to clear the Temple?

In Michael Brown’s book Answering Jewish Objections to Jesus, vol. 3: Messianic Prophecy Objections, I came across an interesting objection that I was always curious about:

Isaiah 53 cannot refer to Jesus because it says the servant of the Lord did no violence [v 9], yet Jesus drove out the Temple money changers with a whip.

I’ve always been baffled as to why Jesus had to use a whip to dive the money changers out of the Temple and if he hit any of the men with it. To my surprise, He did not use the whip to drive out the money changers. Why then the whip?

If one was to look at the first three Gospels (Matthew 21:12-13; Mark 11:15-17; Luke 19:45-16) it does not mention that He used a whip to drive out the money changers. So where do we get the idea that He used a whip to drive the men out of the Temple courts? The only place it is mentioned that Jesus used a whip is in John 2:13-16

13 When it was almost time for the Jewish Passover, Jesus went up to Jerusalem. 14 In the temple courts he found men selling cattle, sheep and doves, and others sitting at tables exchanging money. 15 So he made a whip out of cords, and drove all from the temple area, both sheep and cattle; he scattered the coins of the money changers and overturned their tables. 16 To those who sold doves he said, "Get these out of here! How dare you turn my Father's house into a market!"

According to John, why did Jesus use a whip? He used a whip to drive out “both sheep and cattle” not the money changers. The whip was used for the animals and the sharp rebuke was used for the people. So was Jesus being ‘violent’ when he drove the money changers out? The word ‘violent’ in Hebrew (hamas) has to do with actions such as murder, bloodshed, robbery, and assault. The clearing for the Temple can hardly be said to be a ‘violent’ act that would be used to discredit Him from being the Messiah in Isaiah 53:9.