I'd say if it's not a huge gouge, then just live with it. I have some minor scratching on my wheels from doing the same thing, and it doesn't really bug me (now anyway, swore up a storm when I did it originally).
After all, cars are meant to be driven and used, and with that comes the dings...