You make a very good point, man. I think the best argument is what we've covered right here: Pick a good match of parts, set it up properly, tune it up, and you'll be good to go.
You don't wanna be running 1 3/4 headers with a 2 inch exhaust, and Victor Jr heads. :D