For the shoulder, elbow and wrist, it is hard to beat the Thrower's Ten exercises:
For your back pain, you may want to review the exercises in the book Pain Free
by Pete Egoscue http://www.amazon.com/Pain-Free-Revo.../dp/0553379887
You also may want to review the currently running thread on low back pain
Anything actually work for low back pain? http://tt.tennis-warehouse.com/showthread.php?t=455115
And the currently thread on Egoscue therapy:
"Pain Free" by Pete Egoscue http://tt.tennis-warehouse.com/showthread.php?t=446105
I think you will find lots of information in those above threads that will be be very applicable to you.
The underlying theme is that when muscles (which are elastic) are week, they allow too much force to be applied to non-elastic tendons, joints and bones - resulting in inflammation and pain.
[The surprising thing is you don't have to be as strong as someone lifting heavy weights - just be "strong enough" all over to take the stress off the abused structures.]
I hope you find your "holy grail' of being pain free through exercise like so many others have.
[Of course if you are having severe persistent pain you need to get checked out medically.]