I took mine to Autozone cause they can check battery, alternator, and other stuff for free. I had a bad battery a while back, but thought it might be the alternator. After getting a test at Autozone, it was obvious which part to failing.
Unfortuantely, electrical problems are not always that clear.
Oh yeah, once I thought I had a dead battery, but it turned out my starter was bad. A friend luckily was nearby and showed me a trick to starting a manual car with a bad starter (basically, once the car is in motion, quickly pop the clutch in first and bam....the car starts up just perfectly. Of course, you'll have to do that until you fix the problem).
I'd check your engine ground connection at the block. If you're a fan of cleaning your engine bay, it is not too unusual to find that the connection with the wire, bolt, washer, and screw are corroded. Clean these with sandpaper and you've got a "like-new" connection. I clean all of these parts once a year, because of the moisture they get.
The voltage regulator is a part of the alternator. I didn't have to adjust mine, I guess, because my replacement alternator was for my specific car and not a generic one.
Just some ideas. Good luck.