Phil, the H-alpha and SII filters are outside of our visual spectrum so you won't see anything through those.
The H-beta and OIII should be OK - although the pass band for imaging is usually narrower than visual filters, but at least it should block any extraneous light out
