Some CC plates can be flipped. Maybe this is what you did on one side. An alignment is manditory unless you want to chew up the front tires. The whole purpose of installing the CC plates is to give you the ability to adjust both caster and camber to settings that cannot usually be achieved with the stock plate.
Go straight to an alignment shop--you state you made these adjustments to "get the tires level". I'm assuming that means you're eyeballing it. Not a good thing. Limp it to a good shop immediately!
Take them the documentation from MM on how to do your alignment (came with your cc kit). I'd call around and find a shop that has high-end laser setups, and experience aligning lowered cars and performance cars.