My local IGA has these red paper lanterns for just $2.99 each.
They are Halloween stock, so you might have to get in quick before they get sent back to where they came from.
Runs off 2AA batteries and has an on/off switch on the base.
They also pack down flat for storage.
Thought they'd be ideal not just for at home, but for star parties too.
Not sure if all IGA's got them in, but it might be worth while checking them out.