I would try the following as a test.
- Build a wood cage to go around the peir below the upper portion.
- Tighen it down so that the four sides are a solid friction fit.
- Lower the upper portion so that it compresses the cage you build, which should make it solid against the lower portion.