Definitely not.
You only want to loosen them.
If you take them out and you're not holding onto the
secondary, it could fall onto your primary.
My secondary tilts (a bit) and twists once I've loosened the
bolts. The hard part is getting it to stay in the same (correct)
position as you tighten the screws back up.