I remember the first time I played a guy who hit SLICE off the forehand. I was like, "I didn't even think there was such a thing as sliced forehands." But he was a good player and beat me.
So why do we find it more annoying to lose to a player like this? I think it's because we know that to an observer we both look like bad players. We don't mind losing if we look good losing.