Dry dust is not an issue. You can use the swifter to simply clean that off the surface with that electromagnetic pull. The handle/rod will allow you to reach the mirror. The dew spots (with dust settled over time) are tough to remove with dry wiping.
I have successfully cleaned the primary using the swifter duster handle and a microfiber cloth. Did not need to remove the primary, and the rod helped me reach the mirror from the front. Here is the link to the duster handle -
LINKWhat I did was to wrap the microfiber cloth in the tongues / forks, and just use the painters tape at the bottom to hold that as a role. Left some room on the top (about a couple of inches) to create the "mop". You can then use your choice of cleaning solution (Pec-12, or the lens cleaning wipes, soap solution, etc). What I'd suggest to use one piece of cloth per wipe (go CW or CCW once, and use a new piece of cloth for the second round). I use the costco lens wipes. They are very wet, and I soak/wet the microfiber cloth "mop" by wrapping the lens wipe on the cloth and let the moisture soak-into the cloth. Then I use this semi-wet "mop" to clean the mirror.
Disclaimer - this is my approach, and if you decide to follow it, please do it at your own risk.