I would suggest keeping the scopes for different purposes separate, so as to avoid making unnecessary or undesirable compromises...
For astrophotography, start with a well corrected small refractor - around 80mm or so. The short focal length will be easier to handle on mounts costing less than a small car. And the scope can also act as your grab and go
Then for more serious visual, get yourself a larger Dobsonian. Depending on what you're interests are, 8-12 inches aperture, but see/try before you buy because they can get big
Astrographs, or at least the fast focal ratio ones, make it very hard for less than expensive eyepieces to give a pleasing view.
Of course, if you've got the budget that would buy a medium sedan, there are many other solutions we could suggest
