If you have a lot of build up, use clean hand towels and any glass cleaner. It may take several cleanings to get any road grime residue off. Especially if you drive with your windows down a lot. Once your windows are clean, paper towels and glass cleaner will do fine.
The way ammonia works to clean glass is actually by breaking down parts of the glasses chemical structure (SiO2). If you dont have tinted windows, it doesnt really matter if you have a cleaner with ammonia, but if you have tinted windows, dont use ammonia based products like windex.