My guess is that you're playing with the wrong mindset.
For example, when I first moved to England and started playing Sunday league football, I was on a pretty good team that won most of the time. We won two cups and nearly won the league, but it was rarely ever fun. Even when they were winning, they couldn't enjoy it. And on the occasions they lost, it was even worse. Unfortunately, most of the other teams were the same, so switching teams wasn't really going to improve things. Eventually, I just stopped playing and focused on stuff I enjoyed more (tennis, skiing, etc.).
The point is that it's your mindset and your attitude towards the game that is wearing you down. If you play to have fun and try to win while you're at it, you'll have a good time. If you play to win with enjoyment being a secondary concern, then you'll end up shattered.
You only have yourself to blame.