Skip to content

This repository has scripts that allow you to generate INMET datasets for public weather stations.

License

Notifications You must be signed in to change notification settings

alvarofpp/dataset-inmet

Repository files navigation

INMET datasets

This repository has scripts that allow you to generate INMET datasets for public weather stations.

Datasets

You can find the datasets in data/.

Weather station data.

Column Type Description Example
region string Region in which the weather station is located. "CO"
federal_unit string Federal unit in which the weather station is located. "DF"
station string Name of the weather station. "AGUAS EMENDADAS"
code_wmo string WMO code of the weather station. "A045"
latitude float Latitude of the weather station's geographical position. -15.596491
longitude float Longitude of the weather station's geographical position. -47.625801
altitude float Altitude of the weather station's geographical position. 1030.36
foundation_date date Date the weather station was founded. 2008-10-03

Dataset generated after running transform_filter_wmo.py (e.g. A304.csv).

Column Type Description Example
date date Date of record (YYYY-MM-DD). 2003-02-24
time string Time of record (HH:mm), UTC. "10:00"
precipitation_total float Total precipitation (mm). 0.0
atmospheric_pressure_station_level float Atmospheric pressure at station level, hourly (mB). 1009.0
atmospheric_pressure_max_before float Max. atmospheric pressure at time before (mB). 1009.0
atmospheric_pressure_min_before float Min. atmospheric pressure at time before (mB). 1008.5
global_radiation float Global radiation (Kj/m²). 1392.0
temperature_air_dry_bulb float Air temperature - dry bulb, hourly (°C). 23.2
temperature_dew float Dew point temperature (°C). 22.1
temperature_max_before float Max. temperature at time before (°C). 23.2
temperature_min_before float Min. temperature at time before (°C). 22.9
temperature_dew_max_before float Max. dew temperature at time before (°C). 22.1
temperature_dew_min_before float Min. dew temperature at time before (°C). 21.6
humidity_relative_max_before float Humidity relative maximum at time before (%). 94.0
humidity_relative_min_before float Humidity relative minimum at time before (%). 93.0
humidity_relative_air float Relative air humidity, hourly (%). 93.0
wind_direction float Wind, hourly direction (gr) (° (gr)). 318.0
wind_blast float Wind, maximum rain (m/s). 3.5
wind_speed float Wind, time speed (m/s). 1.5
wmo_code string WMO code. "A304"

Scripts

  • extract_zip.py - Download data from INMET.
  • transform_zip_to_unzip.py - Unzip the INMET zip files.
  • transform_combine_unzip_by_year.py - Groups all files from the same year into a single file.
  • transform_filter_wmo.py - Generates a file with all the records of a weather station.

Generate

In your environment:

# Install requirements for scripts
pip install -r requirements.txt

# Run the scripts in this order
python3 extract_zip.py
python3 transform_zip_to_unzip.py
python3 transform_combine_unzip_by_year.py
python3 transform_filter_wmo.py

In transform_filter_wmo.py, You must change the value of code_wmo to the WMO of the desired weather station.

If you have Docker and Makefile installed on your machine, you can execute the make build command to create the image, followed by make shell to access a container and execute the aforementioned steps to generate the files.

Contributing

Contributions are more than welcome. Fork, improve and make a pull request. For bugs, ideas for improvement or other, please create an issue.

License

This project is licensed under the CDLA-Sharing-1.0 License - see the LICENSE file for details.

About

This repository has scripts that allow you to generate INMET datasets for public weather stations.

Topics

Resources

License

Stars

Watchers

Forks