As a basis starting point your horizon must be set absolutely level for the ball hear or panorama clamp, so the axis you rotate the lens/camera around will be absolutely vertical.
Then set/check the nodal point for the, focal length for zoom, and focus distance of the chosen lens.
I would recommend the program PTgui, simple and precise to work with.