Removing the emissions components will make it nearly impossible to pass emissions. If you are tested just leave the systems alone. Not sure on a carb'd car, but with efi the EGR does not hurt power and will actually improve mpg. Removing the pump will help power but if you have cats they will most likely plug up quickly.
There have been a lot of threads on emissions stuff.
Good Luck