Practical Formulas for the Refraction Coefficient

Abstract

Knowledge of the actual refraction coefficient is essential in leveling surveys and precise electromagnetic distance measurement reduction. The most common method followed by the surveyor for its determination is based on the use of simultaneous reciprocal zenith observations. The commonly used formula is only an approximation valid for approximately horizontal sightings, whereas the exact geometric solution turns out to be very complicated so that an iterative computation procedure is suggested instead. In the present paper, the goal is to derive a compact formula from the complete solution that is easy to implement and retains the necessary accuracy for horizontal and slanted sightings. In addition, the paper will also focus on the common situation for the surveyor where isolated observations have to be done and no partially compensating procedures—e.g., leap-frog or middle point—are possible. If temperature vertical profiles are unknown then the refraction coefficient cannot be reliably determined. Some surveyors may customarily use then an average value, e.g.,