Upshifting manually is fine, downshifting can get a bit rough on things because the pump isn't doing much in terms of lubrication when you are off the throttle.
I could always power brake it when I had the n/a auto...my back brakes didn't work though