I believe you are on the right course of action but I am not sure how you are going to use the drill. Seems as though no matter how careful you are you could take off too much. I would use lapping compound first.
I would like to apologize to anyone I have not offended. Please be patient I will get to you shortly.