A bit of both, houghy.
Dead batteries is fine - I replaced all of the batteries last year, but some of them just don't work anymore - bulbs gone etc.
Found these, could be ok:
http://www.theglassvotivecandleshop.com.au/prod168.htm
Pretty pricey at $10 each.