I use microfiber for everything. I have a microfiber wash mitt, drying towels, and detailing towels.
One of the most important things you can do to avoid swirls is to use proper washing techniques. Get a good quality mitt, don't blast the water when you have dirt all over the car, and rinse...