What you will wear will ultimately depend on how cold it is. Personally I've played outdoors many times with the temperature between 0'C and +4, I end up wearing compression shorts and a long sleeve base layer top, with a microfleece top, underneath a RF jacket. As for bottoms I find I don't need any fleece and am fine with just standard warm up pants. Once I've been moving around for 10-15 mins, I feel perfectly fine.
So for indoors where there's no wind, you'll probably be fine with compression baselayers underneath your regular tennis shirt and shorts. But if the temperature gets lower than 7 or so, you'll probably want another layer.
6 x Head MGPMs, 3 x Head i.PMs, Gamma X-ELS