If it's that bad, how does it only happen while going over speedbumps?
As noted, give the front end a once over. End links like to make noise on speedbumps but they generally make a metallic clicking.
Strut bushings can make a lot of noise as the damper compresses and they deflect. Check yours.
And please let folks know what year and sort of mods your car's suspension has.