I only put cam lube on the cam when installing it into the block. It helps protect the bearrings. I've never "broken in" a roller cam for a period of time though.
As for the lube messing with the blower, don't worry about it. I've started freshly built motors with the blower installed...