Match PEMS stations with SHN postmiles

[tiffanychu90]

PeMS

shared_utils

• new state highway network postmile datasets added into shared_data_catalog.yml + where it was downloaded / wrangled / exported in shared_data.py

SHN postmiles

• Add SHN postmiles open data source to shared_utils/shared_data_catalog.yml
• Add function to create SHN postmile segments to shared_utils/shared_data.py
• ESRI layer downloaded from Geoportal hits a 2,000 row limit. Add a script that can hit the layer until we grab all the rows present in shared_utils.arcgis_query.py so we can use this whenever the need arises.
• create SHN postmile segments, where a segment is drawn between the current postmile and subsequent postmile.
  • this should make plotting PeMS metrics much easier, since stations are not attached to postmiles, and postmiles can also be represented as lines
  • maybe we'll switch to prior postmile to current postmile later? let's see if current to subsequent works well.

PeMS to SHN merging

• PeMS stations (many detectors are grouped as stations) should match with SHN postmiles somehow, if we ever want to be able map volumes / speeds / occupancy, etc on a map.
• Create a crosswalk that matches the columns related to SHN from PeMS with the open data version of SHN postmiles (~0.1 mi) points.
  • use station_uuid in our PeMS crosswalk, since each station's freeway_id, direction, county, city, etc columns are constant
  • favor PeMS naming where we can for the merging....all stations must merge onto SHN postmile points, but not all postmile points necessarily have a station.
  • Use absolute postmile, which is odometer in SHN postmiles and abs_postmile (rounded) in PeMS
• Research Request - PeMS lane dataset + postmiles geospatial data #1210

[github-actions]

nbviewer URLs for impacted notebooks:

• traffic_ops/02_station_postmile_mapping.ipynb
• traffic_ops/03_shn_segments.ipynb

[github-actions]

nbviewer URLs for impacted notebooks:

• traffic_ops/02_station_postmile_mapping.ipynb
• traffic_ops/03_shn_segments.ipynb

[github-actions]

nbviewer URLs for impacted notebooks:

• traffic_ops/02_station_postmile_mapping.ipynb
• traffic_ops/03_shn_segments.ipynb