Try checking the starter to see how many amps the starter is drawing. When it is hotter it may be drawing more causing the starter to turn slower. I know a lot of ignition parts some times fail when the engine is hot but not cold, so could be the same with your starter.