I remember a few things that influenced me. I grew up in a small town, in a rural area so I got to see a lot of the sky at night.
I also remember getting some "recent" National Geographic magazines, I think from my grandfather, about the probe that had reached Jupiter and discovered a lot of new moons. (Yeah, that was a while ago now...
). It was fascinating stuff. (side note: at the time, the school science classes were still teaching Jupiter with 4 moons and I threw a spanner into our class with the updated info. :p ).
There was also the whole SF fascination, plus the various rocket launches, etc. And a visit to Parkes Radio Telescope.
But, it wasn't until recently that I got more into it - combination of time, funds, etc. aligned. I should have started earlier!