I agree with what you guys are saying, but it seems that even on a calm day with no adverse weather conditions, the situation is still the same. A well hit serve outdoors just doesn't seem to be the same as a well hit serve indoors. I actually practice my serve a lot and much of it is done outdoors.
Difference in toss perception is something I haven't thought about. I'll have to keep that in mind.