Maybe the advice should be - pick the weaker side.
As a 1hb player, even if I am hitting vs a 2hbh player, odds are their backhand still isn't as good as their forehand and my forehand is better than their back hand.
Depends on your defintion of "good". Lot's of folks' FH have way more pace than their BHs, but that ain't "better". The OP's FH had way more pace than his opponent's BH , but it was less consistant, so it was "worse" and he lost those points.