Geometrically it does - assuming your left eye is looking at the left frame, and the right eye is looking at the right frame, then the front object has to be displaced to the right in the left-hand frame. Test this by placing two fingers, one directly behind the other in front of your nose, then closing each eye alternately. I used to do a lot of work with this kind of technique for geomorphic mapping from aerial photographs, so I got very familiar with the geometry.
I presume you're not somehow seeing the right frame with the left eye and the left frame with the right eye? I'm not even sure I could torture my eyes into that position, but hey, it might be possible!!