gas mileage will be low, you may see some black smoke from the tail pipes if it's really bad, you may start running rough due to buildups, I'm sure there are others but those come to mind first.
Best way to fix it if you're heavily modded is with a tune, otherwise little things like a CAI and full exhaust should help even it out a bit.