Tell him you beat him with your B game and that you didn't need to play your best tennis.
This guy sounds like he's trying to make you feel like a loser and him the winner. Some people will do anything. Nice try.
Facing Federer book was called "pretty addictive" by Steve Tignor :)