If you are measuring directly on the battery posts, then it is a bad battery. It should stay above 9V while cranking.
It sounds like a bad connection, cables, solenoid or starter.
If you can put your voltmeter leads across a cable, for instance from the pos battery post to the solenoid...