As a golfer I've noticed that effect as well.

It seem the same with either an iron or wood.
I've always thought it was due to some sort of vacuum created in the air behind the club head as it swings through the arc.
As the tee pops up it is caught in the vacuum and pulled backwards.
Just a thought. Cheers