From what I remember it's all underground and the above ground entrance is very unassuming and you would not think there was a cave system there at all. Yes there are steps; web site says 150 steps to the Cathedral cave which is the one I recommend as it is quite spectacular. When they turn to lights out there is absolute darkness.
See
http://www.wellingtoncaves.com.au