As best I can recall, given that it is more than 50 years ago since I studied Form 5 physics, the direction of the magnetic field was related to, or perhaps defined by the direction of the deflection of a compass needle placed above the conductor. Or have the years befuddled my aging brain - which would not surprise me!
The use of the hand just made a convenient method of remembering which way things went.
Robert