give up the game

Throw in the tower was originally a boxing term, which is often used to mean "throw in the towel" in daily conversation.

I will never win. I'm going to throw it into the tower. I can't beat you, I give up. )

Don't give up so early. )