That is a huge part of it. What I do is make sure my offhand is pulled across my body before I make contact. That will put your swing back on time and you will hit clean. This motion is also connected to the hips opening up as well.
That lag is the real secret to hitting your strokes, having good timing, and effortless power as well.