Daniel
Not a silly question and one of the most asked and often debated question.
The short answer is, the best thing to do is learn to live with a little dirt. A bit of dust will have almost no effect on the mirror or the image it gives. If you pull the mirror out each time it gets a bit on it you are only increasing the risk of dropping the mirror, dropping something on the mirror or damaging the cell which can all do real harm.
If it is really dirty, a guide to washing written by Mike is here
http://www.iceinspace.com.au/63-345-0-0-1-0.html. The coatings on mirrors are actually fairly robust so if they really need a clean, it can be done quite safely.
Cheers
Malcolm