This is a blanket statement and not true. You want the correct sized headed for a given application. I had a 1 7/8" header on my old 345" combination that was shifted at 6700rpms, and was fairly mild, there was no noticable torque loss going from a 15/8" to 1 3/4" header to the 1 7/8"
If you are planning on running nitrous you may want to go up one primary size from what the motor wants NA cause you need to get those hot gases out of the chamber as fast as possible, there is not one answer to this question and if you size the header correctly for the combination, you will be headed in the right direction.