I'd recommend leaving it if you plan to keep the car for a long time, based on my experiences. I did it long ago for looks when my car basically only went to shows, but nowadays I try to drive it more and it's pretty rough without it. Most of the time, the sun is too hot to have the top down, so...