I ended up buying a small, cheap, second hand amp. I do not need anything flashy as I am just playing at home.
So far I have been enjoying it! I went over to my friends house on Saturday and we had a bit of a jam session. They both play guitar and one plays the keyboard so all up in the room we had 5 guitars (2 acoustic, 2 electric and 1 bass) and a keyboard.
The first ever song I learnt on guitar was "Stand By Me" but the first full song I have learnt on Bass is "Spicks and Specks" by The Bee Gees. I could not find any Bass tabs anywhere online due to the song being played on keyboard so what I did was playing random notes looking for the correct ones and I finally did it! Not only I know how to play the song (it's a simple one since I am a beginner) but I also worked out what each tab was which gave me feel good that I worked it out!