I don't trust my alternator much but I don't think it's the problem. This is because I charged the battery to around 13 volts. Then I left the car over night. In the morning I checked the voltage and it was at 4 volts.
Do you own a test light? If you do,disconnect the negative terminal on the battery and connect the test light between the negative post on the battery and the negative terminal. If it lights up(even a little) you've got a draw on the system somewhere. Start pulling fuses until the draw goes away and that will tell you where to look.
Turns out it is my alternator, just not in a normal way. I traced the short to my alternator. My alternator seems to be draining 4 amps when the car isn't on. I'm thinking it's time for a 3G upgrade.