quick rack/pinion ?

when i actually did it, they came off very easy with a wrench.

But now i cant get the rack/pinion to come loose from the steering column. I have everything else off and tried for about an hour to get it loose but no luck. it looks pretty much like the neck of a bicycle (rack) how it goes into the frame (column) with the clamp holding the neck into the frame.
I loosened the clamp up and got it to come out a little but can not get it to fully come out.
Any Ideas?