The air silencer is for NVH standards and desires. It has a purpose, though many enthusiasts choose to omit that silence for a more visceral experience and slight HP gain.
Again, because someone doesn't notice a difference in something doesn't mean it has no purpose. E.g., people mismatch MAF sensors and housings or use the wrong combination and say the car runs great. It's still not right.