You need to start stacking your shots Warren.
Download Deep Sky Stacker.
It's really intuitive to use. No dramas.
Yeah the other one that stacked 5 exposures was done in DSS I just need to take the mutiple exposures to stack I am at the begining of the learning curve with stacking but have got the bug
Welcome to the conumdrums of imaging. You go ISO3200 to make up for the short exposure and you go short exposure to limit the stars becoming eggy. The ISO setting on a DSLR is really a sensitivity booster. It isn't adding anything to the image it is simply amplifying whatever was recorded.
Unfortunately that includes noise. F3.5 for 20 seconds is not going to leave much of a signal. So that leaves maybe 60-90 seconds before you start to really notice the stars going eggy.
ISO1600 may be a better setting and the lowest F ratio your lens will go.
A good lens for this sort of shot is the Nikon 50mm F1.4. Canon no doubt has an equivalent. Not that expensive ($100?) and super fast. You would be amazed at how much brighter your shot would be with just 60 seconds of exposure at ISO1600.
There is also an F1.2 but it may be more expensive
20 secs is about my maximum for 35mm. I shoot with a nikon too.
If kyou dont have one get a nikkon af-s 35mm f1.8. ripper of a lens. great wide open and lovely and sharp at f/2. you'll gather a whole lot more photons with it