Tell him you beat him with your B game and that you didn't need to play your best tennis.
This guy sounds like he's trying to make you feel like a loser and him the winner. Some people will do anything. Nice try.
"In the beginning my coach was angry at me because I was too nice on the court." --Gustavo Kuerten