You are experiencing the wide eyed, deer in headlights experience ALL of us feel when we are outmatched by a stronger player.
EVERY player goes thru this.
The only cure is to play stronger hitters and better players, and pretty soon, you will adjust.
Watch vids of Federer just hitting with a top 10 men's pro. He don't move his feet, he's casual about prep, he swings slow and easy, and he's on time everytime.
You only get quicker by playing hard hitters.