Congratulations Mark, you captured the Large Magellanic Cloud!
Yes, the infinity position on your lens is not the infinity position

One trick I do is to focus in auto mode during the day time, then mark the position on the focusing ring and the lens itself (piece of paper with a dark pen mark, stuck down with clear sticky tape).
Then at night time, simply switch to manual focus, then line up the two marks and hold it down with a bit of blue tack to prevent the focusing ring moving and you are all set!
Good luck
Bo