Could definitely be a problem, though I'm not sure if that's causing the symptoms you describe. A good test is to degrease the area really good, especially around the gasket area. Then drive for a bit and see if the oil returns.
Another source of oil leaks is the valve cover gaskets, but that would result in oil on top of the headers and spark plug wires not on the bottom.