Problems with how the USTA Rates Players and Possible Solutions

DCNJ

Rookie
But again even if they decide that yes lopsided teams are always significantly stronger than a team with two players at about the average USTA can put caps on the ends just like they do now with their doubles leagues. As you say most captains will want to have players near the average for convenience reasons anyway.

Starts with arguing against caps, argues for caps.
 

Moon Shooter

Hall of Fame
Starts with arguing against caps, argues for caps.

Yes the position of the cap is important. If your cap is .05 higher than the average of what some teams put on the court that is very different than if the cap is .75 higher than the average of what any team can put on the court.

Someone .75 higher than the average player on the court should know he really doesn't belong. But someone that is only .05 higher than the average of what a team plays would not necessarily feel he doesn't belong. This matters when it comes to legitimacy.
 

Moon Shooter

Hall of Fame
I said:
"I just find it absurd that players would intentionally throw games to gain some slight increase to win a trophy. But I am not surprised that some players would do that if they felt they had to or they could no longer play competitive tennis at all."

And DCNJ's reply to that quote was:

I hope you realize that not everyone thinks in exactly the same way or has the same motivations. Understanding that would be a good start.

I don't think everyone thinks exactly the same way I do. People can decide for themselves whether what I said is similar to their own thinking. It is is my view that most of the tennis players I have run into would generally agree with what I said.

Do you think being able to play in a league at all is more important to most USTA players than winning a level trophy for most adult tennis players? Ian expressed that view in his interview with Heather.

Should it be? If it should be then maybe USTA should stop hyping sectionals and nationals so much. Maybe they should find other things to hype such as the ability to get an objective rating. USTA seems to want to control behavior by hiding information on ratings but then they hype the stuff that leads to the worst behavior instead of what promotes more rational behavior.


I'm assuming with the second half of the quoted material that you're talking about someone (for instance) who is a 4.5 and a bump to 5.0 would result in that, if there were no 5.0 or 4.5+ leagues in their area or that exist anymore.

Yes. In my area there are no men's 4.0 leagues so if someone was to get bumped out of 3.5 they would no longer be able to play USTA men's tennis at all.
 

DCNJ

Rookie
Yes the position of the cap is important. If your cap is .05 higher than the average of what some teams put on the court that is very different than if the cap is .75 higher than the average of what any team can put on the court.

Someone .75 higher than the average player on the court should know he really doesn't belong. But someone that is only .05 higher than the average of what a team plays would not necessarily feel he doesn't belong. This matters when it comes to legitimacy.

Yes, but the point is that you'll have to put an arbitrary cap in place, and then you can use the same argument that you've used against caps in here--what's the difference between someone being 0.75 and 0.70 above the average, or between 0.70 and 0.65, or between ...
 

Moon Shooter

Hall of Fame
Yes, but the point is that you'll have to put an arbitrary cap in place, and then you can use the same argument that you've used against caps in here--what's the difference between someone being 0.75 and 0.70 above the average, or between 0.70 and 0.65, or between ...

The important difference is how much above the average player on a team are they. In the current system you might be .05 above the average player on a team yet can't play against them. A .05 difference means you are have a bit over 53% chance of winning. In other words you are pretty much dead even with the average player on that team. In my system you wouldn't be capped out unless you were much higher than the average rating of any team. If you are .75 above you have a bit over a 96% chance of winning against the average player on any team. So yes it is easy to see why the cap in my system is much more reasonable.

This analysis is based on schmke's figures:

For example, when I looked at it a few years ago, specifically looking at how often the favorite wins a match grouped by different gaps between the players, it revealed this which looks very much like you'd expect.

GapWinning %
0.00 - 0.0553%
0.05 - 0.1563%
0.15 - 0.2575%
0.25 - 0.3584%
0.35 - 0.4590%
0.45 - 0.5593%
0.55 - 0.6595%
0.65 - 0.7596%

I have not done nor have I seen this sort of analysis done for UTR, but it would be interesting to see if it is similar.
 

DCNJ

Rookie
So you adjust your argument based on what you want your final result to be. OK. As I said before, pretty intellectually dishonest, especially after it's been pointed out to you to continue to make such arguments, but go ahead. Argue that there's not much difference between a 3.49 and a 3.51 player and so why allow one but not another, but then argue the exact opposite (wherever you put the cap you're talking about in your post above, there will be someone 0.01 above and 0.01 below that you can make THAT EXACT SAME ARGUMENT.
 

Moon Shooter

Hall of Fame
So you adjust your argument based on what you want your final result to be. OK. As I said before, pretty intellectually dishonest, especially after it's been pointed out to you to continue to make such arguments, but go ahead. Argue that there's not much difference between a 3.49 and a 3.51 player and so why allow one but not another, but then argue the exact opposite (wherever you put the cap you're talking about in your post above, there will be someone 0.01 above and 0.01 below that you can make THAT EXACT SAME ARGUMENT.


I put the italics in my response in order to emphasize the point. Try to focus on the words in italics. Then you will see why the cap in my proposal is more reasonable.
 

DCNJ

Rookie
I put the italics in my response in order to emphasize the point. Try to focus on the words in italics. Then you will see why the cap in my proposal is more reasonable.

Wow..back to "if you disagree with me you obviously must not have read or understood what I said".

Hint: nobody is 'the average player'. The thing you say is the important difference is something I disagree with.

A cap is a cap. Nothing about what 'the average' on the other team is has any effect on a cap being a cap.
 

Moon Shooter

Hall of Fame
Wow..back to "if you disagree with me you obviously must not have read or understood what I said".

Hint: nobody is 'the average player'. The thing you say is the important difference is something I disagree with.

A cap is a cap. Nothing about what 'the average' on the other team is has any effect on a cap being a cap.


The issue has never been about caps per se. It has always been about whether a cap is arbitrary. If your goal is to use the rating system to create matches between players that are somewhat equivalent in strength, then setting the cap to prevent a player that is the same skill level as many team averages seems unreasonable. The current caps directly frustrate the goal.

If however the cap is well outside of the average strength of the teams in that level it is a very reasonable cap. It does indeed promote the goal of having people of equivalent strength play each other.

Whether this difference is important to you depends on whether you think it is worthwhile to have the league set up to have people of similar strength play each other. If you don't care about that then you will be fine with having people excluded from playing other people that are by and large the exact same strength as they are.

Some people may have the goal of giving their own densely populated tennis areas a big advantage versus the rest of the country. Such a person would not care about whether the matches are competitive but really only care that it will help them win in the post season play. They would not like the changes I propose at all. They will be glad these caps are positioned such that it is impossible to build a competitive team in most of the country. So yes whether this is an important difference depends on what goals you are looking to pursue.

Whether an average player exists is irrelevant. USTA still uses ratings to determine strength and we can use them to determine a average strength of the players on the team.
 

DCNJ

Rookie
The issue has never been about caps per se. It has always been about whether a cap is arbitrary. If your goal is to use the rating system to create matches between players that are somewhat equivalent in strength, then setting the cap to prevent a player that is the same skill level as many team averages seems unreasonable. The current caps directly frustrate the goal.

If however the cap is well outside of the average strength of the teams in that level it is a very reasonable cap. It does indeed promote the goal of having people of equivalent strength play each other.

Whether this difference is important to you depends on whether you think it is worthwhile to have the league set up to have people of similar strength play each other. If you don't care about that then you will be fine with having people excluded from playing other people that are by and large the exact same strength as they are.

Some people may have the goal of giving their own densely populated tennis areas a big advantage versus the rest of the country. Such a person would not care about whether the matches are competitive but really only care that it will help them win in the post season play. They would not like the changes I propose at all. They will be glad these caps are positioned such that it is impossible to build a competitive team in most of the country. So yes whether this is an important difference depends on what goals you are looking to pursue.

Whether an average player exists is irrelevant. USTA still uses ratings to determine strength and we can use them to determine a average strength of the players on the team.

The issue was that you used some "logic" to argue against something, but then that same "logic" can be used for what you're proposing, but now you're saying your logic doesn't apply because reasons. What that really means is the "logic" wasn't correct. It's the same argument. It can't hold water in one case and be wrong in another.

And the problems with not having a cap and using your 'proposal' have been explained. Unfortunately, you think that the most common reply is that you haven't played or captained USTA. So while you're complaining about others supposedly not having read or understood what you've been saying...
 

damazing

Rookie
Does your area not have the leagues that are designed to allow players of differing levels to play together on the same team - Combo and Tri-Level?
 

Moon Shooter

Hall of Fame
Does your area not have the leagues that are designed to allow players of differing levels to play together on the same team - Combo and Tri-Level?


I asked the coordinator to be on any sort of team. She said there were some mixed doubles teams and I said sure let them know I am interested. But I never heard back. I think it may be that those teams only take members that belong to a certain tennis club in our town. I belong to the other one. But I am going to join get a membership at both. So I may be able to get on a team next season. But I am not really interested in playing doubles competitively. I am happy to play doubles every now and then but I am much more interested in playing singles competitively.

But to answer your question Tennis record is showing 2021 combo leagues for women in my area but not for men and no Tri-Level.
 

damazing

Rookie
USTA always wants to expand playing options. One of the limiting factors is people stepping up to captain teams. I would think the coordinator would be happy if someone offered to captain a men's combo or singles league team.
 

S&V-not_dead_yet

Talk Tennis Guru
I asked the coordinator to be on any sort of team. She said there were some mixed doubles teams and I said sure let them know I am interested. But I never heard back. I think it may be that those teams only take members that belong to a certain tennis club in our town. I belong to the other one. But I am going to join get a membership at both. So I may be able to get on a team next season. But I am not really interested in playing doubles competitively. I am happy to play doubles every now and then but I am much more interested in playing singles competitively.

But to answer your question Tennis record is showing 2021 combo leagues for women in my area but not for men and no Tri-Level.

BTW: I just attended a tournament where brackets were determined by NTRP but seeding within the bracket was done by UTR. So UTR was good enough for the TD to use to do relative ranking, its fluctuations notwithstanding. Why is it not good enough for you to chart improvement?
 

Moon Shooter

Hall of Fame
USTA always wants to expand playing options. One of the limiting factors is people stepping up to captain teams. I would think the coordinator would be happy if someone offered to captain a men's combo or singles league team.


That could be. I originally didn't want to captain a team because I never even played on a team and still often forget where I am supposed to stand on the court. But I will offer to captain a team if others want to play and just not do the logistics.

BTW: I just attended a tournament where brackets were determined by NTRP but seeding within the bracket was done by UTR. So UTR was good enough for the TD to use to do relative ranking, its fluctuations notwithstanding. Why is it not good enough for you to chart improvement?


UTR may be fine if they start having events near me. I think COVID really hit UTR at a bad time. It may be many of the concerns here about ratings moving up and down are because of COVID and your ratings change if the people you played against in the past play and get unexpected results.

I noticed UTR seems to have something similar to play your court where you can apparently sign up to play individual rated matches against other locals.

Check this out:

The problem is there is no way to tell UTR you are interested in playing matches against local people. So you have to find someone on your own and then get them to sign up to UTR and agree to be rated by UTR. Play your court sets that up for you.
 

Moon Shooter

Hall of Fame
For those that wonder how USTA nationals is rigged against less densely populated areas here is the post where I explain it:

My entire county only has 25,000 people and the nearest densely populated areas are in separate local leagues. We do have issues at the 4.5 level so our players have to play in adjacent local leagues, but we have teams from 3.0 to 4.0 this year with 18&over, 40&over and 55&over teams. So yes, I'm really confused at how a metro area with 390,000 can't do the same.

Can you please explain why you think flexibility will fix the problems in your area when areas across the country are creating leagues under the current system with no problems?


I gave you specifics about my area. I am in the Illinois Mid south discrict we have Peoria Springfield Bloomington/Normal Decatur and Pekin in our area. There is only one league for men it is 3.5 and under and has 3 teams. You are extremely vague about who is on your teams and where they are from. I don't even know what division you are playing in. So it is impossible to actually address your point.


I agree larger tennis communities have an advantage for the reason you describe. But you seem to imply players/teams outside of these areas have no shot. I don't think that is the case.

If we look at 2019 Nationals, specifically the 18+ and 40+ leagues, and look at what areas made it there, e.g. won Sectionals, if your hypothesis is true, we'd expect to see the vast majority of areas represented to be the larger population areas. In fact, you make it sound like only those areas would be represented. Well, that isn't really the case.

In Southern, Atlanta is the hotbed for tennis with a vibrant tennis community, so you might expect that area to lead the way, and they do, but not by that much and a lot of other areas had teams make it to Nationals:

Atlanta - 4
Baton Rouge - 2
Knoxville - 2
Lake Norman, NC - 2
Birmingham - 1
Little Rock - 1
Jonesboro, AR - 1
Louisville - 1
Monroe, LA - 1
New Orleans - 1
North Central, MS - 1
Rock Hill, SC - 1
Nashville - 1

That is pretty broad representation and is not exclusively major/large cities.

Let's pick another section, Intermountain:

Salt Lake City - 8
Vegas - 5
Denver - 4
Boise - 2

Note of course there is virtually no league tennis outside of these cities, but even a small area like Boise is represented, and the largest area, Denver, is 3rd of the 4 areas.
[emphasis added]

Do you agree that the bolded is a problem?

But anyway I would love to see a comprehensive listing of teams that made it to nationals and won nationals in the different categories. Are you aware of any such lists?

In Mid-Atlantic, the same players play in many different counties in MD, Virginia, and D.C., and those collectively do lead the way, but smaller areas like Richmond (4), Shenandoah (3), and Virginia Beach (1) all sent teams to Nationals. These smaller areas certainly weren't excluded.

In Middle States, you might expect NJ/Philly to hog all the teams making it to Nationals, and they do lead the way, but Delaware (2), Central PA (1), and Allegheny Mtn (3) are all represented, so again, smaller areas not excluded.

So, when you look at who actually makes it, teams from all over have a real shot and do make it.

Your entire pitch seems to be yes it is rigged against less densely populated areas but sometimes they can still make it to nationals. I think your data actually proves my point. If it is level based play why rig it against smaller communities at all? If you average the players that play (as I propose) you wouldn't grossly rig the system against smaller communities. USTA intentionally chooses a system where larger communities win just because they can stack players in a very narrow range of skill.

Since the system is rigged against smaller communities in this way, are we surprised that there are virtually no leagues outside of these larger cities? (As I bolded in your original quote.)

I'm not saying that going into the playoffs is the only motivator to play in a league. But it is a motivator. Why restrict this reason to play in a league to densely populated areas?
 

Moon Shooter

Hall of Fame
I transplanted this from a different thread because I didn't want it to get too derailed by this discussion. I think it fits better in this thread.

I understand what you mean, but your situation is not quite the same. These players we are discussing are high level 4.0 and know what their ratings are plus they aren't accidently backing into sectionals on their first try at USTA, they all have usta match experience, it's just part of the way things are, they are scheming to create teams to beat other teams that are scheming in the same manner.

I understand. I think when people play in clubs that have leagues with many teams they will know much more than people like me.

Do you only get strikes if you win the match? The way I understand it is an appeal or self rate gets a strike if 1) their dynamic rating is above a threshold and 2) they perform in a match above a certain threshold. But your "performance rating" against someone considerably out of your level may be well above level if the match is close.

Lets say two self rates play each other late in the season. And assume they both have a dynamic rating that is above whatever threshold USTA uses for a strike. If the match is close enough it would seem possible that both the winner and the loser of the match could end up with a strike.

This may be an even more likely scenario: Since USTA did not update ratings this year it seems someone could have have had a dynamic rating of 3.47 two years ago as they just started playing competitive tennis. Thus they would have a computer rating of 3.5. But if they improved about .8 over the past two years they might have a dynamic rating of about 4.27 which is a mid 4.5 level. Is it possible a self/appeal rated player could lose a very close match to this computer rated opponent and still get a strike?
 

Creighton

Professional
I transplanted this from a different thread because I didn't want it to get too derailed by this discussion. I think it fits better in this thread.



I understand. I think when people play in clubs that have leagues with many teams they will know much more than people like me.

Do you only get strikes if you win the match? The way I understand it is an appeal or self rate gets a strike if 1) their dynamic rating is above a threshold and 2) they perform in a match above a certain threshold. But your "performance rating" against someone considerably out of your level may be well above level if the match is close.

Lets say two self rates play each other late in the season. And assume they both have a dynamic rating that is above whatever threshold USTA uses for a strike. If the match is close enough it would seem possible that both the winner and the loser of the match could end up with a strike.

This may be an even more likely scenario: Since USTA did not update ratings this year it seems someone could have have had a dynamic rating of 3.47 two years ago as they just started playing competitive tennis. Thus they would have a computer rating of 3.5. But if they improved about .8 over the past two years they might have a dynamic rating of about 4.27 which is a mid 4.5 level. Is it possible a self/appeal rated player could lose a very close match to this computer rated opponent and still get a strike?

Yes. You can get strikes while losing matches. Especially if you’re playing up against like you said against someone with a very high rating.
 

Moon Shooter

Hall of Fame
Yes. You can get strikes while losing matches. Especially if you’re playing up against like you said against someone with a very high rating.

Are we seeing more DQs lately? I imagine by now some 3.0 and 3.5 c rated players have dynamic ratings pretty far above their class. I wonder if the Strike margins widened because USTA didn't adjust ratings last year.
 

schmke

Legend
Are we seeing more DQs lately? I imagine by now some 3.0 and 3.5 c rated players have dynamic ratings pretty far above their class. I wonder if the Strike margins widened because USTA didn't adjust ratings last year.
I wrote about it a few months ago. At the time, yes, DQ rates were higher, around 60% higher than 2019.
 

Moon Shooter

Hall of Fame
I wrote about it a few months ago. At the time, yes, DQ rates were higher, around 60% higher than 2019.
I saw an early article. But I missed this article:
and this article

I would have thought there would be an even higher rate of DQs by the end of this year because computer rated players have much more time to improve their dynamic rating which would seem to lead to many more chances a self/appeal rate can play a match where they perform above the threshold. If we did not see more DQs then I would think they changed the thresholds.

It seems the DQs up to June 1 of 2021 was about 63% compared with 2019. I would predict that the rate of DQs between June 1 of 2021 and September 1 of 2021 is higher than the 63% so far as compared to 2019. The only reason I think it may not be is if there already were so many DQs that many of the players already got bounced so basically there are just fewer appeal and self rates left to be DQed.
 

J B

Semi-Pro
people dont want to Captain teams because its miserable. Usually due to the USTA ratings. New players quickly tire of the joke of a system and older players think they paid their dues and deserve something. Then finding players is the big complaint but then captains look at USTA ratings and make a decision off a doubles only rating. I keep asking my captain to bring the player out and hit. Then the player destroys the captain and he passes... he's better than a 4.0 so he will get DQ'd. Honestly its like little league in a town where the coach is there to make sure his kid gets to play first and pitch. Has no clue of the game.

All of this stems from a horrible rating system that I cant just go to a pool of players and KNOW that I am getting a 3.5 thats missing a few strokes for my 7.5 combo. I have no idea if its a real 3.5 or not. Then again most 4.0 and lower teams think you are supposed to guard the line in doubles so.....
 

Moon Shooter

Hall of Fame
IMO the rating system should be based on wins and losses. (the whole having someone decide how good you subjectively is less interesting to me) I think there definitely can be certain pockets of ratings that are off base from the national averages but by and large I think USTA ratings do a pretty good job of letting you know how well someone will do. Schmke did some research and the ratings did show a somewhat predictable and reasonable relationship between rating and winning percentage.

I suppose at lower levels you could have more variability as far as strengths and weaknesses in your tennis game. You could be very out of shape and have a terrible back-hand if you have a great serve and and a few other weapons. Also at a lower level someone may have a weak serve but might still do ok if they are in very good shape and have good ground strokes etc. Players can try to work out strategies of play that work with their strengths and weaknesses. It might be because there can be such a mixed bag of players that the ratings do not seem to be working well.
 
Top