Ratings comparison - play good against stronger, or dominate weaker?

ChaelAZ

G.O.A.T.
I was thinking about ratings the other day and I know this had been kinds presented in the past here, but I don't know if it has ever been demonstrated in a mathematical way of how the algorithm might works for a player in different situations. Maybe @schmke has something already, or maybe someone can point me to one of his wonderful posts about, but let me create a scenario.

Here are the scenarios:

Player is 3.75, so mid 4.0 (could be a 3.25 mid 3.5 player, 4.25 mid 4.5 player, etc...just that middle level rating player)
The question is, given an average player at a level, is it better from them to dominate a lower ranked player, do very well against an equal level players, or do good against a higher ranked player?

3.75 Plays a 3.5 rated player and wins 6/0 6/0
3.75 Plays another 3.75 rated player and wins 6/3, 3/6, 1/0 (what if it was actually a loss at 6/3, 3/6, 0/1?)
3.75 Plays a 4.0 rated player and loses 3/6, 3/6

Anyone have a feel for these? I have always wondered how that would all work out as a comparison. Especially with that USTA statement we have talked about, "3.5 player can fall anywhere between a 3.01 and a 3.50. A typical match result for a player with a 3.01 rating versus a 3.49 player, both of whom are 3.5s, would be 6-0, 6-0 in favor of the higher rated player".

Thanks for any answers.
 
3.75 Plays a 3.5 rated player and wins 6/0 6/0 Improved rating for the 3.75 as a 3.75 isn't supposed to be a 3.50 0&0 3.50 player decreases.
3.75 Plays another 3.75 rated player and wins 6/3, 3/6, 1/0 (what if it was actually a loss at 6/3, 3/6, 0/1?) Will result in very little change as this is supposed be a dead even match. Whichever player wins will see a slight increase in rating and whichever loses will see a slight decrease.
3.75 Plays a 4.0 rated player and loses 3/6, 3/6 Would guess both would stay about the same.

schmke can obviously answer better than I can though.
 
I was thinking about ratings the other day and I know this had been kinds presented in the past here, but I don't know if it has ever been demonstrated in a mathematical way of how the algorithm might works for a player in different situations. Maybe @schmke has something already, or maybe someone can point me to one of his wonderful posts about, but let me create a scenario.

Here are the scenarios:

Player is 3.75, so mid 4.0 (could be a 3.25 mid 3.5 player, 4.25 mid 4.5 player, etc...just that middle level rating player)
The question is, given an average player at a level, is it better from them to dominate a lower ranked player, do very well against an equal level players, or do good against a higher ranked player?

3.75 Plays a 3.5 rated player and wins 6/0 6/0
3.75 Plays another 3.75 rated player and wins 6/3, 3/6, 1/0 (what if it was actually a loss at 6/3, 3/6, 0/1?)
3.75 Plays a 4.0 rated player and loses 3/6, 3/6

Anyone have a feel for these? I have always wondered how that would all work out as a comparison. Especially with that USTA statement we have talked about, "3.5 player can fall anywhere between a 3.01 and a 3.50. A typical match result for a player with a 3.01 rating versus a 3.49 player, both of whom are 3.5s, would be 6-0, 6-0 in favor of the higher rated player".

Thanks for any answers.
For the scenarios you outlined, assuming singles and using my algorithm for estimating dynamic ratings, the best to worst result would be:
  • 6/0, 6/0 win over 3.50
  • Tie-break win over 3.75
  • Tie-break loss to 3.75
  • 3/6, 3/6 loss to 4.00

The first is clearly the best result, about 0.2 higher than the others, the other three are covered by about 0.1.
 
For the scenarios you outlined, assuming singles and using my algorithm for estimating dynamic ratings, the best to worst result would be:
  • 6/0, 6/0 win over 3.50
  • Tie-break win over 3.75
  • Tie-break loss to 3.75
  • 3/6, 3/6 loss to 4.00

The first is clearly the best result, about 0.2 higher than the others, the other three are covered by about 0.1.

Would your estimated algorithm give the same result for a 6-3, 6-3 win over 3.5 as a 3-6, 3-6 loss to 4.0 (for 3.75)? I assume so, but then I realized that perhaps the gradients are more complex than I thought.
 
Is it really sandbagging if everyone else is sandbagging too though?
From my vantage point ... 2021 EVERYONE is sandbagging. Because no ratings changes from last year there are so many people out of level, running around with C ratings ....
At 3.5 there is a higher % bumped each year than at 4.0 or higher levels .... so we have the 15% that should have been bumped last year and the 15% from this year .... fun fun fun.

Actually, it is, but seeing a lot more blow out scores at S1 and D1 than I can recall in the past.
 
Would your estimated algorithm give the same result for a 6-3, 6-3 win over 3.5 as a 3-6, 3-6 loss to 4.0 (for 3.75)? I assume so, but then I realized that perhaps the gradients are more complex than I thought.

The problem with 6-3 scorelines is that it can be either 1 break or 2 .... and yet it is going to be treated the same.
 
I guess in my mind they are.
For me, I don’t like getting broken especially in singles. Apart from trying to win the match and minimize the number of games won by my opponent, a secondary goal I start with in every singles match is not to get broken. Unfortunately, I don’t get broken only in about 20% of my singles matches (and 15% of doubles) matches. Although I don’t keep track, my guess would be that I break my opponent in more than 95% of singles matches as it is rare for me to incur a straight set loss where I did not break serve - in contrast, I get broken at least once in 80% of my matches.

If I’m breaking serve a lot, but getting broken back too, I don’t feel like I’m playing well. But, if I’m holding serve comfortably in a match without facing break points, I feel relaxed during my return games, end up playing better and getting many breaks.
 
Last edited:
For the scenarios you outlined, assuming singles and using my algorithm for estimating dynamic ratings, the best to worst result would be:
  • 6/0, 6/0 win over 3.50
  • Tie-break win over 3.75
  • Tie-break loss to 3.75
  • 3/6, 3/6 loss to 4.00

The first is clearly the best result, about 0.2 higher than the others, the other three are covered by about 0.1.

Thanks!
 
@schmke One more general questions is, does the win/loss hold value in the algorithm itself, or is that value mostly based on the dynamic rating of the match?
 
@ChaelAZ The dynamic rating algorithm doesn't really care about win loss, it is primarily about the score and rating of the players in the match.

@denoted 6-3,6-3 vs a 3.50 and 3-6,3-6 vs a 4.00 aren't exactly the same but are close, at least as I calculate it.
 
@ChaelAZ The dynamic rating algorithm doesn't really care about win loss, it is primarily about the score and rating of the players in the match.

@denoted 6-3,6-3 vs a 3.50 and 3-6,3-6 vs a 4.00 aren't exactly the same but are close, at least as I calculate it.


Ahhh, okay. That answers a lot of what I suspected. I appreciate it. Thanks.
 
@ChaelAZ The dynamic rating algorithm doesn't really care about win loss, it is primarily about the score and rating of the players in the match.

@denoted 6-3,6-3 vs a 3.50 and 3-6,3-6 vs a 4.00 aren't exactly the same but are close, at least as I calculate it.
I'm sure this has been asked before, but what are the basics of how doubles affects your rating? You could have a partner with the same rating that had a bad day and your team lost, or played above their normal level abd you won. Seems like too many variables to get an accurate rating based on doubles...
 
I'm sure this has been asked before, but what are the basics of how doubles affects your rating? You could have a partner with the same rating that had a bad day and your team lost, or played above their normal level abd you won. Seems like too many variables to get an accurate rating based on doubles...
When you play doubles, your match rating will be higher/lower than your rating prior to the match the same amount as your partner. You are effectively getting the same credit for the rating change as your partner, which is different from the same rating as your partner.

This means that if you only play doubles and only play with the same partner, you and your partner's rating will go up/down the same amount and the ratings will track each other with whatever gap there is between your ratings remaining the same. The only way to break out of this is to play singles or play with different partners.

IMHO, this makes sense, as without any other data, there is no way for the algorithm to know which partner is stronger/weaker in a given match. It is only by having other matches, singles or doubles with different partners, where the algorithm can get those alternate data points to gauge each partner's rating. This means if two partners always play together and one gets better and the other worse, their ratings will not reflect that, but again, no way for the algorithm to know that without other match data.
 
When you play doubles, your match rating will be higher/lower than your rating prior to the match the same amount as your partner. You are effectively getting the same credit for the rating change as your partner, which is different from the same rating as your partner.

This means that if you only play doubles and only play with the same partner, you and your partner's rating will go up/down the same amount and the ratings will track each other with whatever gap there is between your ratings remaining the same. The only way to break out of this is to play singles or play with different partners.

IMHO, this makes sense, as without any other data, there is no way for the algorithm to know which partner is stronger/weaker in a given match. It is only by having other matches, singles or doubles with different partners, where the algorithm can get those alternate data points to gauge each partner's rating. This means if two partners always play together and one gets better and the other worse, their ratings will not reflect that, but again, no way for the algorithm to know that without other match data.
That makes sense in the absence of a more accurate way to track folks. Not to oversimplify, but it sounds like if you want to raise your NTRP playing only doubles is to make sure you are not the strongest partner, but either equal or weaker than your partner, unless you are strong enough to carry a weaker partner?
 
That makes sense in the absence of a more accurate way to track folks. Not to oversimplify, but it sounds like if you want to raise your NTRP playing only doubles is to make sure you are not the strongest partner, but either equal or weaker than your partner, unless you are strong enough to carry a weaker partner?
Sort of.

You can actually improve your rating significantly by playing with a lower rated partner if they've improved and their rating is artificially low. If in a given match, if you as a pair do better than expected, you effectively get part of the credit for doing so. But it can go the other way too of course.

Bottom line, the algorithm looks at both players in each doubles team to determine the expected score and then compare the actual score against that. Do better than expected, both partner's ratings will go up, do worse, they'll go down.
 
Sort of.

You can actually improve your rating significantly by playing with a lower rated partner if they've improved and their rating is artificially low. If in a given match, if you as a pair do better than expected, you effectively get part of the credit for doing so. But it can go the other way too of course.

Bottom line, the algorithm looks at both players in each doubles team to determine the expected score and then compare the actual score against that. Do better than expected, both partner's ratings will go up, do worse, they'll go down.
Gaming the system is a lot of work :)
Good thing I don't care what my rating is.
 
Last edited:
Is it really sandbagging if everyone else is sandbagging too though?

Good luck this season! I don't blame anyone for sandbagging I blame the USTA for such having such a pathetic rating system that is easily manipulated if people choose to do so. The golf handicap system is vastly superior in counting the best eight rounds out of 20 rounds. The USTA doesn't care about rating's manipulation so why should teams and players?

IMO, sandbaggers are a very small percentage of tennis players, probably less than 1 percent. I find most players overrate themselves. Plenty of 4.5S and 4.0S who get clocked when the face average 4,5 and average 4.0 players. I watched 3.5 guy playing a 4.0 match today and he should truly appeal down to 3.0. he had no business on a court with 4.0 players. And both of these 4.0 guys were former 4.5 guys, so this made that match even more heinous.

If a player is very good and at my level with a "S"or "A "rating, I appreciate the challenge of playing them and the satisfaction of beating them. If they beat me, they are the better player, not a sandbagger or player who merits derogatory comments.

Just a note. Our team won 8.0 Mixed Nationals in 2016 with all players holding C ratings for at least 4-5 years each. No self-rated players, no appeal down players on the team and only one 4.5 guy. We had six 4.0 guys and five 4.0 women. So you can win 8.0 mixed with a bunch of 4.0 players and without self-rated players. But yes the 4.5 guys certainly help but they aren't sure things on every team.
 
Last edited:
To me in the my area it seems those who sandbag never played college tennis and getting to nationals is that important to them, mixed, tri-level, regular, very willing to manipulate ratings and winning at nationals almost doesn't matter in what category, the winning is more important than the competition or quality of the tennis matches. Of course some high high level division 1 guys mixed in with others to go to the 5.0+ national championship out of Dallas recently, naturally that's not sandbagging ;).

IMO, sandbaggers are a very small percentage of tennis players, probably less than 1 percent. I find most players overrate themselves. Plenty of 4.5S and 4.0S who get clocked when the face average 4,5 and average 4.0 players. I watched 3.5 guy playing a 4.0 match today and he should truly appeal down to 3.0. he had no business on a court with 4.0 players. And both of these 4.0 guys were former 4.5 guys, so this made that match even more heinous.
I think you are right about the small percentage, but look at some Texas state 4.0 and 3.5 teams churning and burning out of Houston and Dallas, sometimes Austin and the percentage goes to 70% for sure. 4.5 and 5.0 the shenanigans stop. It's interesting you mention the self rate, got a buddy who is going from 4.0 to 5.0 this season to play with some friends, I fear the carnage will be brutal, just hope the opponents can enjoy it.
 
would you be so kind and explain how a rating system should be made better to make manipulation impossible?

To make USAT ratings manipulation impossible is highly unlikely. Those are your words, not mine. But to make rating manipulations much more difficult would be easy.

This would solve 99% of the USAT's rating problems.

1) Count every match that advances to a championship, including mixed. But exclude any non-advancing matches from the algorithm . If you can generate an M rating, the USAF algorithm either works or it doesn't work. If a fall league doesn't advance, why on earth would the USTA use a rating in a league where teams can tank.?

2) ban self-rated players from any championship matches

3) Use anti-tanking code in the USTA Algorithm. That doesn't exist clearly.

4) Generate computer ratings after number of matches, not once a year. 6 to 8 matches should be sufficient to generate a computer rating. Which would negate any ban of S Ratings players be banned from championships, local/state/regional. Think about this. A player can self rate and play 3 matches and get 3 strikes if they play In an advancing league for their gender. But if a player self rates plays two mixed matches, then plays combo then a fall league, that player could be playing USTA tennis matches for over 18 months before they generate a USTA C rating. That process can and should be shortened. @schmke could better estimate the number of matches that could accurately generate a rating, but no the USTA's process is flawed and easily manipulated if one decides to do such.

The fact someone can self rate and play only combo and never generate a rating ever at all is just one example of the USTA's failed algorithm.

5) Eliminate the computerized appeal down and appeal up process completely. If the USTA's algorithm were accurate, why would they even need an appeal down process? This is separate from medical appeals. I have multiple 4.0A down players on my team and think the appeal process needs to go away. Sure these guys help my team, but I think the concept is wrong. Fix the algorithm and make it accurate. The appeal process validates the USTA knows their algorithm is flawed so they make room to appeal up and down. This is laughable.

6)Establish Nationals Standards for what counts and what doesn't count (non-advancing leagues). The USTA Is a National Organization, so no more of 17 Sections making individual rules of what counts and what doesnt count.
 
Last edited:
I find most players overrate themselves. Plenty of 4.5S and 4.0S who get clocked when the face average 4,5 and average 4.0 players.

This is absolutely correct. I have seen so many guys show up at our club trying to claim 4.0 or 4.5 status based on the USTA website descriptions, previous experience, pure vanity, or other reasons. It often goes like this: 55+ year old guy joins club, says he is 4.0, wants to join USTA team, does a few group drills, all the 4.0 captains lose his number, guy then says club is elitist and not welcoming, club pro then gives him the names of 3.5 or 3.0 captains, he says he is already rated 4.0S and will not play with the jokers at 3.5 and why is this club so hard to break in to... and so on.
 
You can actually improve your rating significantly by playing with a lower rated partner if they've improved and their rating is artificially low.

This unintentionally happened with one of our guys two years ago. He was an older guy who self rated as a 3.5. He was an average 3.5 but nothing special. Unfortunately, the club allowed him to captain. So he paired himself every match with a young guy who had improved greatly but the rating system hadn't caught up to so he was still a 3.0

This led to the 3.5S getting bumped to 4.0 where he is now hopeless. Even though all of their wins were the result of the 3.0 player.
 
This is absolutely correct. I have seen so many guys show up at our club trying to claim 4.0 or 4.5 status based on the USTA website descriptions, previous experience, pure vanity, or other reasons.

Defintely see this more often with S rated than not. The ones recruited to S rate for a team that wants to win nationals is very small and I think most would agree, very concentrated to certain sections and teams.
 
This is absolutely correct. I have seen so many guys show up at our club trying to claim 4.0 or 4.5 status based on the USTA website descriptions, previous experience, pure vanity, or other reasons. It often goes like this: 55+ year old guy joins club, says he is 4.0, wants to join USTA team, does a few group drills, all the 4.0 captains lose his number, guy then says club is elitist and not welcoming, club pro then gives him the names of 3.5 or 3.0 captains, he says he is already rated 4.0S and will not play with the jokers at 3.5 and why is this club so hard to break in to... and so on.

that 55+ 4.5S guy you describe above recently moved to town from Maryland and has been repeatedly beat up badly by the 4.0 guys and a few stronger 3.5 guys when he ask 4.0 guys to hit. . He is a perfect example of what you describe. We can't even use a guy like him a 4.0 and he has already self rated 4.5. :unsure: No 4.5 team will ever put him on a team. Guess he can self rate again in three years.

Penty of people on this forum who have never played USTA do the same thing claiming "I'm a 4.0 to 4.5 " based on the USTA rating guidelines.
 
If you have never played USTA and just read their descriptions of each NTRP level, it is easy to over-rate yourself 1 or 2 levels higher than what your actual level is. While some players might self-rate too highly because of their inflated ego, others might be making a genuine mistake. Unfortunately, they will then find themselves shut out of playing USTA tennis for 3 years.

It happened to me twenty years ago when I came back to tennis after a 10-year break. After a few months, I got the idea to play some USTA tournaments and after reading the description, I self-rated at 4.5 and went to a USTA ratings clinic. Since the rater official just watched me play some doubles points for a few minutes, he let me keep my 4.5 self-rating and needless to say, I found out that I was at the wrong level when I played some tournaments. I didn’t get back to playing USTA for another 12 years after that fiasco.
 
If you have never played USTA and just read their descriptions of each NTRP level, it is easy to over-rate yourself 1 or 2 levels higher than what your actual level is. While some players might self-rate too highly because of their inflated ego, others might be making a genuine mistake. Unfortunately, they will then find themselves shut out of playing USTA tennis for 3 years.

It happened to me twenty years ago when I came back to tennis after a 10-year break. After a few months, I got the idea to play some USTA tournaments and after reading the description, I self-rated at 4.5 and went to a USTA ratings clinic. Since the rater official just watched me play some doubles points for a few minutes, he let me keep my 4.5 self-rating and needless to say, I found out that I was at the wrong level when I played some tournaments. I didn’t get back to playing USTA for another 12 years after that fiasco.

Wish I could give you more than one like, because what you said is so true. The problem with the rating system is you have people being honest like yourself. Then you have a second group of people who are just trying to self rate as low as possible ignoring the rating guidelines.
 
If you have never played USTA and just read their descriptions of each NTRP level, it is easy to over-rate yourself 1 or 2 levels higher than what your actual level is. While some players might self-rate too highly because of their inflated ego, others might be making a genuine mistake. Unfortunately, they will then find themselves shut out of playing USTA tennis for 3 years.

It happened to me twenty years ago when I came back to tennis after a 10-year break. After a few months, I got the idea to play some USTA tournaments and after reading the description, I self-rated at 4.5 and went to a USTA ratings clinic. Since the rater official just watched me play some doubles points for a few minutes, he let me keep my 4.5 self-rating and needless to say, I found out that I was at the wrong level when I played some tournaments. I didn’t get back to playing USTA for another 12 years after that fiasco.


The issue is, NTRP may very well describe general technique skill level of players at a level, but the ONLY factor for calculating it is performance of competing and win/loss.

I went to a rating clinic and was rated 4.0, probably more based on athletic ability and being able to keep a ball in than overall strokes. That was a full step up from where I could compete well at the time though.
 
To make USAT ratings manipulation impossible is highly unlikely. Those are your words, not mine. But to make rating manipulations much more difficult would be easy.

This would solve 99% of the USAT's rating problems.

1) Count every match that advances to a championship, including mixed. But exclude any non-advancing matches from the algorithm . If you can generate an M rating, the USAF algorithm either works or it doesn't work. If a fall league doesn't advance, why on earth would the USTA use a rating in a league where teams can tank.?

2) ban self-rated players from any championship matches

3) Use anti-tanking code in the USTA Algorithm. That doesn't exist clearly.

4) Generate computer ratings after number of matches, not once a year. 6 to 8 matches should be sufficient to generate a computer rating. Which would negate any ban of S Ratings players be banned from championships, local/state/regional. Think about this. A player can self rate and play 3 matches and get 3 strikes if they play In an advancing league for their gender. But if a player self rates plays two mixed matches, then plays combo then a fall league, that player could be playing USTA tennis matches for over 18 months before they generate a USTA C rating. That process can and should be shortened. @schmke could better estimate the number of matches that could accurately generate a rating, but no the USTA's process is flawed and easily manipulated if one decides to do such.

The fact someone can self rate and play only combo and never generate a rating ever at all is just one example of the USTA's failed algorithm.

5) Eliminate the computerized appeal down and appeal up process completely. If the USTA's algorithm were accurate, why would they even need an appeal down process? This is separate from medical appeals. I have multiple 4.0A down players on my team and think the appeal process needs to go away. Sure these guys help my team, but I think the concept is wrong. Fix the algorithm and make it accurate. The appeal process validates the USTA knows their algorithm is flawed so they make room to appeal up and down. This is laughable.

6)Establish Nationals Standards for what counts and what doesn't count (non-advancing leagues). The USTA Is a National Organization, so no more of 17 Sections making individual rules of what counts and what doesnt count.
Love point 2. Force rate ALL self-rated players before playoffs begin. If they keep their S rating they play, if the true rating ends up being higher than the S they cannot participate in the playoffs. Simple.
 
These are some pretty well stated arguments. At least you've come up with some ideas rather than just complaining like 90% of people.
That being said let's argue a bit:
[...]

1) Count every match that advances to a championship, including mixed. But exclude any non-advancing matches from the algorithm . If you can generate an M rating, the USAF algorithm either works or it doesn't work. If a fall league doesn't advance, why on earth would the USTA use a rating in a league where teams can tank.?
So two counter-arguments:
#1 well, there are many folks complaining that including results from mixed or even doubles matches makes the rating unreliable. Which is why (I think) mixed results are not counted if one plays enough non-mixed matches.
#2 statistical evidence shows that many, many folks play like 3-5 matches _per year_. I believe @schmke provided some data in the past that showed that median number of matches is 4 per year. If you do not include non-advancing matches then you will end up with so few matches that the ranking is going to be not accurate at all.

2) ban self-rated players from any championship matches
ok, I can see that. Now - it seems that for many folks hope of playing for championship with friends is what makes them join USTA league in the first place. It is going to be pretty hard to convince such a player 'well, you self rate this year, you play but can't join us if we advance, but _next year_ you will be all right. Unless of course people on the team change, get bumped, etc - in which case there's no _next year_'. So sure, that would make it perhaps 'more fair' at a cost of reducing the number of people that play USTA. Which is kind of contrary to what USTA tries to promote.

3) Use anti-tanking code in the USTA Algorithm. That doesn't exist clearly.
what would such anti-tanking code be?

4) Generate computer ratings after number of matches, not once a year. 6 to 8 matches should be sufficient to generate a computer rating. Which would negate any ban of S Ratings players be banned from championships, local/state/regional. Think about this. A player can self rate and play 3 matches and get 3 strikes if they play In an advancing league for their gender. But if a player self rates plays two mixed matches, then plays combo then a fall league, that player could be playing USTA tennis matches for over 18 months before they generate a USTA C rating. That process can and should be shortened. @schmke could better estimate the number of matches that could accurately generate a rating, but no the USTA's process is flawed and easily manipulated if one decides to do such.
I'm not sure if I completely follow here. First, there's that issue of folks playing ~5 matches per year so having ranking based on 8 matches is a tall order. Second, a self-rated player is subject to strikes so effectively his self-rating is evaluated already. If he is not DQ'ed - doesn't that mean that he did not rated too low?
If a player plays two mixed matches, and a combo - a league with no national championship I believe - do you really care what his rating is? I mean we are talking mixed and combo, essentially a social gathering with some physical activity.

The fact someone can self rate and play only combo and never generate a rating ever at all is just one example of the USTA's failed algorithm.
Do you truly think that rating based on combo results is reflecting one's true ability?

5) Eliminate the computerized appeal down and appeal up process completely. If the USTA's algorithm were accurate, why would they even need an appeal down process? This is separate from medical appeals. I have multiple 4.0A down players on my team and think the appeal process needs to go away. Sure these guys help my team, but I think the concept is wrong. Fix the algorithm and make it accurate. The appeal process validates the USTA knows their algorithm is flawed so they make room to appeal up and down. This is laughable.
can't argue too much here, I have no idea what are the grounds for non-medical appeals. I would have no problems with not allowing those. Anyone knows what the reasons for non-medical appeals are?

6)Establish Nationals Standards for what counts and what doesn't count (non-advancing leagues). The USTA Is a National Organization, so no more of 17 Sections making individual rules of what counts and what doesn't count.
sure. Although one can probably see that due to climate/weather differences between sections the number of leagues/matches vary greatly - so perhaps some rules need to reflect those differences.
 
These are some pretty well stated arguments. At least you've come up with some ideas rather than just complaining like 90% of people.
That being said let's argue a bit:

So two counter-arguments:
#1 well, there are many folks complaining that including results from mixed or even doubles matches makes the rating unreliable. Which is why (I think) mixed results are not counted if one plays enough non-mixed matches.
#2 statistical evidence shows that many, many folks play like 3-5 matches _per year_. I believe @schmke provided some data in the past that showed that median number of matches is 4 per year. If you do not include non-advancing matches then you will end up with so few matches that the ranking is going to be not accurate at all.

ok, I can see that. Now - it seems that for many folks hope of playing for championship with friends is what makes them join USTA league in the first place. It is going to be pretty hard to convince such a player 'well, you self rate this year, you play but can't join us if we advance, but _next year_ you will be all right. Unless of course people on the team change, get bumped, etc - in which case there's no _next year_'. So sure, that would make it perhaps 'more fair' at a cost of reducing the number of people that play USTA. Which is kind of contrary to what USTA tries to promote.

what would such anti-tanking code be?

I'm not sure if I completely follow here. First, there's that issue of folks playing ~5 matches per year so having ranking based on 8 matches is a tall order. Second, a self-rated player is subject to strikes so effectively his self-rating is evaluated already. If he is not DQ'ed - doesn't that mean that he did not rated too low?
If a player plays two mixed matches, and a combo - a league with no national championship I believe - do you really care what his rating is? I mean we are talking mixed and combo, essentially a social gathering with some physical activity.

Do you truly think that rating based on combo results is reflecting one's true ability?

can't argue too much here, I have no idea what are the grounds for non-medical appeals. I would have no problems with not allowing those. Anyone knows what the reasons for non-medical appeals are?

sure. Although one can probably see that due to climate/weather differences between sections the number of leagues/matches vary greatly - so perhaps some rules need to reflect those differences.


My counter-arguments to your comments:

1)Doesn't the USTA generate an "M" rating for those players who play 3 mixed matches? If the USTA thinks their algorithm works for Mixed Only matches, why should you doubt it can be applied to all matches? The USTA believes their M ratings to be accurate enough. Of course I don't but hey this is the USTA's poor algorithm, not mine.

2) @schmke can correct me, but I believe the USTA will generate a year-end rating after 3 matches (3 Spring matches, or 3 Mixed matches), therefore if those 3 matches will currently generate a year-end rating. By your own statement
If you do not include non-advancing matches then you will end up with so few matches that the ranking is going to be not accurate at all.

Well the USTA year-end rating generated by the USTA publishes ratings after just three (3) matches, so my suggestion is self-rated players play three matches before any local, state, or regional championship, to generate a USTA rating which every player must get verified locally before advancing to a championship match. All it takes is the local league coordinator running an update to every Self-Rated player's DNTRP. If below the threshold, the player can advance. If above the threshold, the player is bumped up and can't play at the intial self-rating level.

3) my point is this: The USTA's year-end rating (if they publish one at all, e.g, 2020 they did not) coupled with the Appeal Down option is broken and could be tweaked. They tweaked the 40+ leagues to four courts only, with only a few years of comments and complaints. Players, captains and teams have been complaining about the USTA's rating system for years, and the changes are small, and don't stop those who want to exploit their unlocked door. The USTA has a system that can and is exploited if players/captains choose to exploit it. Does it happen to a large percentage of players? I don't know but I think no. Do I think the USTA could generate spring ratings more quickly than they currently do that are more accurate than the M only ratings? Absolutely. Do I lose sleep over anything with USTA? Ha, no. Tennis is a chance to be with some of my friends and to have some fun. I like that I get to run and generate steps, sweat, and have more fun than running.

Read the first post from the thread below and the replies by some well-respected 4.5 players. Now insert this 18-year old (whose father claims he will double bagel 4.0 adults) into 18+ 8.0 mixed with 5.0 C lady, and 8.5 Combo with a 5.0C guy.
Do I want to play those teams? No, not with a 4.0 lady or a 4.5 partner. :( If this 3.5S player who double bagels 4.0 "Adults", gets to play with 5.0 C rated partners in Mixed and Combo, of course, they are going to do well. So to answer your question, "Yes, I do not care to play players like that in Mixed or Combo". And by the way, Mixed has a National Champion. 18+, 40+ at least.


By the way I hit with a 5.0 lady weekly who plays for the USTA National team. No way I want to face her and an 18-year self-rated 3.5C who will double bagel 24-year-old 4.0s.

ok, I can see that. Now - it seems that for many folks hope of playing for championship with friends is what makes them join USTA league in the first place. It is going to be pretty hard to convince such a player 'well, you self rate this year, you play but can't join us if we advance, but _next year_ you will be all right. Unless of course people on the team change, get bumped, etc - in which case there's no _next year_'. So sure, that would make it perhaps 'more fair' at a cost of reducing the number of people that play USTA. Which is kind of contrary to what USTA tries to promote.

This narrative has been brought up so many times. My solution is to have the USTA used the same logic to generate a rating before any championship matches. The only way you get excluded is to not play 3 matches. If the many players you write about join a team in hope of playing for a championship, surely, they can be dedicated enough to play 3 matches. If the USTA's algorithm works to generate an M Rating after 3 matches, so surely the USTA could change and generate a rating after 3 matches to prevent those players who will be most adsurely bumped at the end of the year, out of championship matches when they are clearly out of level. If the "S" rated player is below the level threshold, the player can play in the championship matches. If the "S" rating puts the player over the threshold, the player can't play at the "S" rating. It's really a rather simple solution that could be implemented easily. The USTA doesn't lose any revenue or players, and it puts a check-valve on the system. Captains and players would just stop with the excuses about exclusion and my player can't make 3 matches if the USTA made such a change. Don't worry, this will never happen as the USTA doens't care. But you asked me "would you be so kind and explain how a rating system should be made better to make manipulation impossible?"

Anti-tanking code. @schmke and I have discussed this before. It would be rather simple to include the code in the algorithm. For example, a high-level 4.5 player (player A) on a weak team that will not advance plays singles vs an average 4.0 player (Player B), a weak 4.5 (player C) and roughly same level 4.5 (Player D). The players loses all three matches 0&1.

The matches vs player B/C/D are compared to the expected results and the actual results are beyond the threshold for a given probability that player A should lose to player B/C/D.

Player A vs Player B: is not counted as either player's rating as 1) either Player A tanked or 2) player A was so injured he couldn't move, swing, etc. Playing injured at 1/5 or 1/10 capability results in the same net: it is tanking.
Player A vs Player C: if the actual match result is within the USTA threshold bounds of their "acceptable expected match result", it counts towards both player's ratings. If it isn't, the match is not counted.
Player A vs Player D: if the actual match result is within the USTA threshold bounds of their "acceptable expected match result", it counts towards both player's ratings. If it isn't, the match is not counted.

6) Do you think counting matches in a fall league that do not advance serve any valid purpose ? Do you think players, captains don't tank matches in these leagues? This is something that could be easily fixed, but it isn't fixed.

Why? The USTA doesn't care. If the USTA doesn't care about any of these issues, so don't lose sleep and enjoy your life. You asked and I answered.
 
Last edited:
To me, this is a psychology question and it depends on the individual. Does the player need confidence? Do they thrive on challenge? Does their game change when they play against different levels?
 
@schmke

How many matches did it take to generate a USTA year-end rating pre-covid, e.g, 2018/2019? Is it just 3 same-gender matches in an advancing league to get a "C" or 3 mixed doubles match in an advancing league to get an "M" rating?

To see a team with 10 matches and a self-rated player play 2 matches in ten weeks, then advance to a local, state, a regional championship is my point to @jmnk . I am not sold on the weak "exclusion" argument of a self-rated player who can't play 3 matches before a championship. Since 2007, the fewest matches I have seen in any league is 6 matches. Plenty could be done to tweet the USTA's algorithm, and I have written many times the USTA should hire you as a contractor to fix their broken system. I have more faith in you to do right by all USTA players. You have earned that respect and trust. I think most people on this board would agree that we would rather have you running the USTA algorithm than anyone the USTA hires.
 
@schmke

How many matches did it take to generate a USTA year-end rating pre-covid, e.g, 2018/2019? Is it just 3 same-gender matches in an advancing league to get a "C" or 3 mixed doubles match in an advancing league to get an "M" rating?
It has been and remains 3 matches to my knowledge. Note, in sections that include non-advancing league matches in year-end ratings, the 3 matches are across all same-gender leagues played in during the rating year.

To see a team with 10 matches and a self-rated player play 2 matches in ten weeks, then advance to a local, state, a regional championship is my point to @jmnk . I am not sold on the weak "exclusion" argument of a self-rated player who can't play 3 matches before a championship. Since 2007, the fewest matches I have seen in any league is 6 matches. Plenty could be done to tweet the USTA's algorithm, and I have written many times the USTA should hire you as a contractor to fix their broken system. I have more faith in you to do right by all USTA players. You have earned that respect and trust. I think most people on this board would agree that we would rather have you running the USTA algorithm than anyone the USTA hires.
Note that the USTA has made it a little more stringent on self-rates advancing to playoffs. It was done for 2020 so I believe is still in play for 2021, and wrote about it back in 2019 on my blog, but the gist is that where a player had to play only 3 matches to be eligible for Nationals, they now have to play 4. Sections are free to impose similarly stricter requirements for States/Districts/Sectionals, but I'm not sure how many are.

While the 4 is an improvement, I think it is likely still too few. And if Sections still allow fewer and allow defaults to count towards the total, it doesn't really crack down on things short of Nationals.
 
@schmke

if the USTA doesn't have Nationals in 2021, have you read or heard anything regarding a plan to issue 2021 Year End Ratjngs?

I am not concerned about going to Nationals or getting some S rated players bumped up. Just curious if you have any information given so many players with A or S ratings currently.
 
@schmke

if the USTA doesn't have Nationals in 2021, have you read or heard anything regarding a plan to issue 2021 Year End Ratjngs?

I am not concerned about going to Nationals or getting some S rated players bumped up. Just curious if you have any information given so many players with A or S ratings currently.
I have not heard what they'd do should there be no 2021 Nationals. I can't imagine they would not publish again ...

Of course, they could just dump NTRP and switch to WTN and get away with just publishing the conversion! Yes, wrote about that on my blog last Fall.
 
Back
Top