I have one handed backhand and have trouble with return as well.
Common tips are very short backswing (or none), block it back.
You want to turn shoulder quickly as well.
It's a tough shot.
Wouldn't swinging across the body cause the shoulder to open up too soon? And possible shanking? For one hander the shoulder has to remain closed (stay in line with the aim)