Brake help FAST!

Ok so just changed rotors and pads on the rear brakes on my stock 96 GT. Went out for a drive and smelled something odd, parked it, and the rear left brake/caliper was smoking. Got it back home slowly and pulled the wheel off to let it cool, and find that the inside pad wasnt seated right and it seemed as if they were gripping partially the whole time........the pad - rotor - pad looked like / | |

We let it cool down, took it apart, and find that the rotor wasnt square on there. So i held the rotor in so it was straight/square and my dad tried to put the caliper back on and its impossible. If the caliper is to fit in, the rotor is forced to have the front pointing out more, which makes the pad fit like the little "diagram" i have above. Any solutions as to fix this or will i need to run out and get a new rear caliper?

Also ... the portion that the bolts that hold the caliper go into have the rubber backing on them, like they are supposed to be able to move in and out somewhat, but neither of them will budge, even with a c clamp. the car sits on a jack as i type this and a storm front is moving in too so help ASAP would be appreciated, thanks!

well for now we just put an old pad on there as that was the only way it would fit. The thing that was being a ***** was the caliper mount, the top portion where you bolt the caliper onto the mount, it has the rubber part on it so you'd think it should give a little (it did on the passenger side) but that wouldnt budge. The piston was all the way back too, i have a feeling a complete brake kit will be in order soon.