No one is ready to receive service the instant their feet get to the intended spot.
Just keep your head down and look up when you're ready. If he starts his serve before then, just say "not ready."
I've been in this situation before. They generally get pretty obnoxious by asking "OK? Are you ready now?" every serve, but that only usually lasts a couple of points. Just calmly say "yup" and they get bored of it pretty quickly.
If you play by the rules some might consider you a *. If that's a problem then, by all means, give away as many points as necessary for their approval