Does this mean the space shuttle would need to reach a speed of over 25,000 mph to break out of the atmosphere?
No because spacecraft that go into orbit or beyound undergo acceleration through most of the Earth's atmosphere. Therefore, they do not need to achieve escape velocity.