Yes definitly clean both mating sufaces of old gasket material,antifreeze, oil. You should get the idea.Then after that you can use some alcohol (rubbing alcohol that is) to clean off any sticky stuff in case you missed some. Just make sure you put the head gasket on so they both have the FRONT letters facing the front or else you'll be taking it back apart and have to do it all over again.