Phosphoric Acid will rid you of the rust, can be bought cheaply from hydroponics/aquaponics/pet stores as a product called PH down as it is a fish friendly product for water treatment in aquariums. I believe that it is the active ingredient in CLR for the R part!
It is a strong acid, so be careful.
https://www.hy-gennutrients.com/product/ph-down/