May I suggest a trick I've seen. Don't hold them in the normal position - hold them by the barrels, as close to the objective (field) lenses that you can. You can understand the lever theory - any shaking is not as greatly magnified. It feels odd and takes a bit of getting used to, but may work for you.
