Dust deposition in the Southern Ocean constitutes a critical modulator of past global climate variability, but how it has varied temporally and geographically is underdetermined. Here, we present data sets of glacial-interglacial dust-supply cycles from the largest Southern Ocean sector, the polar South Pacific, indicating three times higher dust deposition during glacial periods than during interglacials for the past million years. Although the most likely dust source for the South Pacific is Australia and New Zealand, the glacial-interglacial pattern and timing of lithogenic sediment deposition is similar to dust records from Antarctica and the South Atlantic dominated by Patagonian sources. These similarities imply large-scale common climate forcings, such as latitudinal shifts of the southern westerlies and regionally enhanced glaciogenic dust mobilization in New Zealand and Patagonia.