3 - 4 Horsepower isn't worth the value loss, to me.
If you ever take a lady out, you may just want that AC running.
Besides, ever try to defog your windows without it?
If you're gutting the car, for the track... that's fine. There's a whole lot of other items to remove before you bypass...