I'm in the EXTREME minority with the following view.
The rule says that you only call a ball out if you are 100% SURE it was out. Now to me, if you (and your partner) were 100% sure, you would have no problem calling the ball out and not feel a bit uncomfortable about calling such balls out in the future. The fact that you are uncomfortable tells me you think there is a chance the ball might have landed in. As such, BY RULE, YOU MUST NOT CALL THE BALL OUT. You need to play these balls and continue the point.
The rule is written so that you will almost certainly play out balls. But I'd say 99.99% of people interpret the rule the way you do. In that they call it out if they are "pretty sure" it was out. For me, that's not good enough.
In "friendly" matches (which for me, is pretty much every match, including league matches if I find myself playing them), I'll only call a ball out if I am 100% sure it was out. And even then, if my opponent questions my call and get's angry, I'll apologize give him the point without any discussion. Now I'll admit, this might be a bit extreme. But I'd rather do this than waste time and "emotional currency" arguing with a guy about a line call and then playing with that hanging over the rest of the match. I'd much rather just give them the point and continue playing. I've given away critical points (basically match ending points) in situations like this without giving it much thought.
Now, what I hate are opponents that won't assist in making a line call on my side of the net. For example, when I'm on the far side of the court and my opponent hits a ball down the line. There is no way from my perspective that I can call a ball that is close "out" with 100% certainty. But my opponent is right on the line and knows FOR SURE if their shot was in or out. So, I'll often just ask them. Sometimes they'll make the call. But more often then not, they'll say "it's your side of the court, so you have to make the call". And even in instances where I am "pretty sure" their shot must have been out (both because it looked out to me, but also by their reaction), I'll just say "well then I'll have to give you the point, because I can't call it out from my perspective over here".
In the end, I'd rather give my opponent every point (even if they hit the back fence) then play "lawyer ball" with anybody. That is my idea of a terrible time.