Xtreme Energy cams are generally noisy, almost like running a solid cam from what I have heard.
What procedure are you following for adjusting your rockers? The pushrod you are running is very close if not optimal unless you have had the heads or deck milled.