I have not done exactly that, but there are two ways, one is to remove and replace the glass on the window regulator bracket, and the other, is to change the glass with the bracket and guide attached. I think the actual glass is riveted to a steel bracket that rides up and down. It may take a large rivet gun or special rivets. May be easier to change the whole assembly.
Overall, it should not be too hard. The salvage yard I was in last Sat had several cars with damaged doors. You could go to one and check it out before trying yours.