Theres a lot of people who wont put a lens pen anywhere near an eyepiece..... but a mirror?
NEVER EVER EVER rub your mirrors with anything dry!
Theres plenty of online information about how to safely clean mirrors, so I can only agree with you in saying, yes you did a stupid thing
