Is it a pretty loud metal rattle sound? And also does it go away when you are pressing the brake pedal?
If it does, than I had the same problem. To make a long story shory, I somehow missed that I was a little low on brake fluid. I put some more fluid in there and the clunking hasn't been back since.