Great Circle Distance Calculator (Haversine Formula)

What is Spherical Trigonometry, Geodesy, and Great-Circle Navigation?

A great circle is any circle whose plane passes through the center of a sphere. On Earth, all meridians (lines of longitude) are great circles. The equator is a great circle. Parallels of latitude (except the equator) are NOT great circles — they are small circles. The fundamental property of great circles is that the arc connecting any two points on a sphere, measured along a great circle, is always the shortest possible path between those points. This is why transoceanic flight paths appear to curve on a flat map — the flat Mercator projection distorts the geometry of a sphere.

Mathematical Foundation

Haversine Formula — Great Circle Distance

a = \sin^2\!\left(\frac{\Delta\phi}{2}\right) + \cos(\phi_1)\cdot\cos(\phi_2)\cdot\sin^2\!\left(\frac{\Delta\lambda}{2}\right)

\phi

= Latitude in radians. Convert decimal degrees to radians by multiplying by π/180. North latitudes are positive, South latitudes are negative. Valid range: −π/2 to +π/2.

\lambda

= Longitude in radians. East longitudes are positive, West are negative. Valid range: −π to +π. The formula uses the difference Δλ = λ₂ − λ₁.

a

= The haversine of the central angle — an intermediate value in [0, 1]. When a = 0, the two points are identical. When a = 1, the points are diametrically opposite (antipodal) on the sphere.

c

= c = 2 × atan2(√a, √(1−a)). The central angle in radians subtended by the arc connecting the two points at the center of the Earth. This is the angular distance, not the physical distance.

d

= d = R × c. The great-circle (geodesic) distance along the Earth's surface. R = 6,371 km (Earth's mean radius). Multiply d_km by 0.539957 for nautical miles, or by 0.621371 for statute miles.

Initial Bearing

\theta = \text{atan2}(\sin(\Delta\lambda)\cdot\cos(\phi_2),\; \cos(\phi_1)\cdot\sin(\phi_2) - \sin(\phi_1)\cdot\cos(\phi_2)\cdot\cos(\Delta\lambda))

\theta

= Initial true bearing in degrees (0° = True North, clockwise). This is the direction you must point at departure to fly the great-circle path. The bearing changes continuously along the route — a great-circle path is NOT a constant-heading course.

Laws & Principles

Why Flat-Map Straight Lines Fail: The Mercator projection preserves angles (conformal) but severely distorts distances and areas at high latitudes. A straight line on a Mercator map represents a rhumb line (constant compass bearing), not a great circle. A flight from Los Angeles to Tokyo that follows a constant westward heading (a rhumb line) is approximately 400 km longer than the great-circle path that curves far north over Alaska. Every fuel tankload saved by flying the correct route is worth tens of thousands of dollars.
The Polar Routing Effect: Great circles connecting cities in the Northern Hemisphere naturally arc toward the North Pole. JFK→LHR curves over Nova Scotia and Iceland. LAX→NRT curves over Alaska. This is geometrically correct — the pole is the 'short side' of the sphere. In winter, airlines sometimes fly slightly south of the optimal great circle to avoid strong jet stream headwinds, accepting a slightly longer path for better fuel economy.
Haversine vs. Vincenty Formula: The Haversine formula treats Earth as a perfect sphere (R = 6,371 km). For most aviation and navigation purposes, this is accurate to within 0.3%. For geodetic surveying requiring millimeter precision, the Vincenty formula accounts for Earth's oblateness (equatorial radius = 6,378 km, polar radius = 6,357 km, flattening = 1/298.257). The Haversine formula's main advantage is numerical stability — it avoids the floating-point issues that plague the simpler spherical law of cosines near small distances.
Nautical Miles and the Arc-Minute Convention: One nautical mile (NM) is defined as exactly one minute of arc of latitude (1/60th of a degree of latitude) along a meridian. Earth's circumference = 360° × 60 NM/° = 21,600 NM = 40,003 km. This makes nautical miles uniquely convenient for great-circle navigation because you can read distance directly from a chart's latitude scale. No conversion factor is needed.
Antipodal Points: Two points are antipodal if they are exactly opposite each other on the globe (e.g., Madrid and Auckland, or the North Pole and South Pole). The great-circle distance between antipodal points is exactly π × R = 20,015 km (half Earth's circumference). Any path between them is equally a minimum — the concept of 'direction' to an antipodal point is undefined.

Step-by-Step Example Walkthrough

" Calculate the great-circle distance from JFK (40.6413°N, 73.7781°W) to LHR Heathrow (51.4700°N, 0.4543°W). "

1. Convert to radians: φ₁ = 40.6413° × π/180 = 0.70919 rad, λ₁ = −73.7781° × π/180 = −1.28741 rad, φ₂ = 51.4700° × π/180 = 0.89844 rad, λ₂ = −0.4543° × π/180 = −0.00793 rad.
2. Differences: Δφ = 0.89844 − 0.70919 = 0.18925 rad, Δλ = −0.00793 − (−1.28741) = 1.27948 rad.
3. Compute a: sin²(0.18925/2) = sin²(0.09463) = 0.08949² = 0.00894. cos(0.70919) × cos(0.89844) = 0.75988 × 0.62756 = 0.47690. sin²(1.27948/2) = sin²(0.63974) = 0.59620² = 0.35545. a = 0.00894 + 0.47690 × 0.35545 = 0.00894 + 0.16954 = 0.17848.
4. c = 2 × atan2(√0.17848, √0.82152) = 2 × atan2(0.42246, 0.90638) = 2 × 0.43614 = 0.87228 rad.
5. d = 6371 × 0.87228 = 5,556 km = 3,001 NM = 3,451 statute miles.
6. Initial bearing: θ = atan2(sin(1.27948)×cos(0.89844), cos(0.70919)×sin(0.89844) − sin(0.70919)×cos(0.89844)×cos(1.27948)) = atan2(0.95631×0.62756, 0.75988×0.77856 − 0.64938×0.62756×0.29025) ≈ 50.8° — initial heading North-Northeast.

Final Result: JFK to LHR great-circle distance: 5,556 km (3,001 NM / 3,451 mi). Initial bearing: ~51° (NNE). The flight arcs over Nova Scotia and Iceland — much further north than a straight-line path on a flat map would suggest.

Quick Answer: What is a Great Circle Distance?

The Great Circle Distance is the mathematically shortest path between any two points on the surface of a sphere. Unlike a straight line on a flat map (which heavily distorts reality), a great circle path curves across the globe, slicing perfectly through the Earth's center. For long-distance aviation and maritime navigation, flying or sailing this exact geodesic arc is the only way to minimize travel time and optimize fuel burn.

Navigation Standards & Spherical Pitfalls

Standard Operating Procedure

✓Always use decimal degrees accurately. Coordinates given in Degrees, Minutes, and Seconds (DMS) must be meticulously converted to decimal degrees (e.g., 40° 30' = 40.5°). Small rounding errors at the input stage mathematically multiply across thousands of miles.
✓Understand varying initial headings. Unlike following a compass line, flying a great circle requires continuously updating your heading. The "Initial Bearing" calculated is strictly the direction you point the nose the moment you depart.

Lethal Pitfalls

✗Confusing Rhumb Lines with Great Circles. A rhumb line is a path of constant bearing (e.g., pointing a compass straight West and locking the autopilot). While easier to fly, a rhumb line geometrically spirals toward the pole, artificially adding hundreds of unnecessary miles to trans-oceanic crossings.
✗Ignoring the WGS 84 Ellipsoid variance. The Haversine formula models Earth as a perfect sphere. For 99% of general aviation, this is adequate. However, for GPS programming or artillery targeting requiring millimeter precision, you must use the Vincenty algorithm to account for Earth's oblateness.

Frequently Asked Questions

Why do flight paths look curved on a map?

It is an optical illusion created by the map itself. Most maps use a Mercator projection, which wildly stretches the Earth's polar regions to force a 3D sphere into a 2D rectangle. When you plot a mathematically straight Great Circle path across this distorted map, the line ironically appears to curve sharply upward toward the poles. If you look at the same route on a physical globe, it is unarguably straight.

What is the Haversine formula?

The Haversine formula is an equation utilized in spherical trigonometry to determine the great-circle distance between two longitude-latitude coordinates. It utilizes sines and cosines to derive the radial curve over a sphere's surface, remaining highly stable against floating-point errors even when two points are extremely close together.

How much fuel does flying a Great Circle save?

For a widebody airliner flying from Tokyo to Los Angeles, adhering to a great-circle route rather than a constant-bearing rhumb line physically cuts roughly 400 nautical miles from the trip. This shaves off nearly an hour of flight time and saves over tens of thousands of dollars in jet fuel per sector.

Great Circle Distance Calculator (Haversine Formula)

Great Circle Distance Calculator (Haversine)