What makes the O-Factor work--what keeps you on plane in your downswing--is matching the shape of your hip turn with your shoulder rotation. Once your hips start, your right shoulder moves down (not across). It continues down until your hands reach the hitting zone, and then it spins to the target.
Picture the wheels
Top: Stripped to its bare elements, your downswing is fueled by two wheels.