Theoretical and Numerical Aspects of the Geodetic Method for Determining the Atmospheric Refraction Coefficient Using Simultaneous and Mutual Zenith Observations

Abstract

The estimation of the atmospheric refraction coefficient by conducting simultaneous and mutual zenith observations is a well-known geodetic procedure. The respective mathematical model is based on certain assumptions regarding the actual path followed by the optical ray while propagating in the atmosphere (spherical symmetric model). Starting from this model an approximate solution can be derived, which is generally accepted in the literature on the subject. The present paper examines the mathematical model of this geodetic technique in a rigorous manner, which results in an exact solution for the computation of the atmospheric refraction coefficient or equivalent for the zenith angle correction that is due to the effect of the atmospheric refraction. As the direct computation of the exact solution is rather complicated, an iterative way of computing the same quantity is derived, which can be realized easily on any pocket calculator. In order to assess the derived formulas we investigate the applicability of the exact, the convergence rate of the iterative and the errors introduced by the approximate formulas, by conducting a representative series of synthetic numerical experiments. The overall discussion aims to provide a helpful insight into the geometric and theoretical features of this traditional geodetic method. To practitioners that attempt to apply the standard correction formulas to zenith observations in order to compensate the effect of atmospheric refraction in the frame of typical surveying applications, such as trigonometric leveling, the paper also points out possible numerical errors introduced by the traditional approximate formulas.