After his obvious stall tactic you should have figured out a way to make him wait before starting the TB, to one-up him. He set the tone and mood of the TB by causing HIS delay. He was in control.
"In the beginning my coach was angry at me because I was too nice on the court." --Gustavo Kuerten