Drift alignment will work and it won't matter if your fork is not parallel with the OTA.
But Baz, remember this is meant to be fun, your hobby, leisurely relaxing activity. You do it by choice not because anyone is making you do it. If it's no longer fun, and is making you upset, just leave it be and do something else more enjoyable.
