Adjusting Roller Rockers? Should I do it?

Ok,

Car Runs fine,

However I didnt adjust my roller rockers when I put them in,
I just bolted them to the heads and in they went,

Now Ive read a few threads about people shimming them ete etc
I have the shims,
Didn't use one lol,

But the car runs fine,
However would I see more HP or smoother revs if I went outside and did them today

I know the whole "If it aint broke don't fix it" thing,
But Id hate to think theres more waiting to come out lol