Outer shock tower removal?

Ok probably a stupid question but better safe than sorry. I need to repair or replace the outer shock towers on my 65 vert. Can I remove the outer with the spring in? The motor is out so not a lot of sprung weight and the outer doesn't seem to have any actual contact with the spring so it doesn't appear to be an issue. I don't even know what the purpose of the outer is other than, I suppose to brace and stabalize the somewhat unusual setup that Stangs have.

Thanks in advance

Thanks, now that you mention it, I really haven't put much thought into removing the springs so it makes just that much more sense