Clearly his reason to be there is different than yours. You are there to win and he is there for social reasons to meet other women. He doesn't want to look bad, losing potential dates with opponents and spectators. This is semi-elite social tennis. Next time have him serve big with topspin, it's harder for the 3.5/4.0 ladies to return than big flat serves and the guy doesn't look like a big meanie. Bribe him with an offer he can't refuse.
"...the human emotional system was not designed to endure the mental rigors of a tennis match." Dr. Allen Fox