Hid Headlights Won't Turn Off.

I've recently experienced some intermittent problems with my HID headlights. At first one would go out and then both. Turns out it was just a loose connection. Now both lights work fine.

But now I am experiencing the HID lights not going off even when turning off the ignition. I had to disconnect the battery.

The switch enables the yellow lamps in the headlights to turn on and off but not the HIDs.

Any ideas?