NOAA Automated Surface/Weather Observations

XANTRONIX · 2025-02-08T03:28:08.650Z

From https://www.ncei.noaa.gov/products/land-based-station/automated-surface-weather-observing-systems :

The Automated Surface Observing Systems (ASOS) program is a joint effort of the National Weather Service (NWS), the Federal Aviation Administration (FAA), and the Department of Defense (DOD). There are currently more than 900 ASOS sites in the United States. These automated systems collect observations on a continual basis, 24 hours a day. ASOS data are archived in the Global Surface Hourly database.

Automated Weather Observing System (AWOS) units are operated and controlled by the Federal Aviation Administration. These systems are among the oldest automated weather stations and predate ASOS. They generally report at 20-minute intervals and, unlike ASOS, do not report special observations for rapidly changing weather conditions.

Historical data dates back to 1901. The FTP endpoint for this data is here: ftp://ftp.ncei.noaa.gov/pub/data/noaa/

I am currently retrieving this data. However, I will update this comment after I have retrieved the full set to indicate its total size.

zyyygz · 2025-02-08T09:41:27.193Z

going by the filesizes for 2024 (3.7GB), the entire dataset may be 500GB

https://www.ncei.noaa.gov/pub/data/noaa/2024/

starting to mirror from 2025 downwards:

lftp -e 'mirror --parallel=10 /pub/data/noaa/2024 ./noaa/2024' ftp://ftp.ncei.noaa.gov/pub/data/noaa/ < /dev/null
...