Lets put some math to this discussion....
The mass of the Sun is known, the mass of the Jupiter and planets are known... it is not that hard to calculate the position of the centre of mass of the solar system, so that we can move away from "feelings" in discussions like this one.... Numbers, numbers....
BTW, it is not the change of the star position, but the change of the star radial speed that reveals the presence of extrasolar planets.
The current detectability is ~1m/s only... still not enough to detect the presence of Earth-size planet at the right distance orbiting around solar-size star..