Sep open data

[tiffanychu90]

sep open data

• run gtfs_funnel, hqta, open_data, segment speeds, rt vs schedule for sep 2024
• [do not publish yet until we patch in operators]
• add published_operators.yml, grouped by dates to see which ones we are missing
  • script in gtfs_funnel/track_publish_dates.py handles this yml generation
  • TODO: go through this list of schedule_gtfs_dataset_names and see where we want to exclude some operators (names changed, etc) that are ok to be missing
  • TODO: look into where we are missing operators that we don't want to be...Amtrak?

hqta refactor

• clean things up since we want to refactor and change methodology soon
• switch from feed_key to schedule_gtfs_dataset_key since gtfs_dataset_key shows up in trips table and we use it in other workflows
• make clear the assumptions we have -- we might want to change these soon
• add _utils.py
• wordy functions can be more clear, especially in the rail/ferry/BRT script
• clean up logs
  • remove notebook checks check1_downloads and check2_hq_corridors...combine the checks into 1 notebook
• Epic - Open Data Publishing 2024 #991

[github-actions]

nbviewer URLs for impacted notebooks:

• high_quality_transit_areas/01_corridors-as-lines.ipynb
• high_quality_transit_areas/02_hqta_green_SACOG.ipynb
• high_quality_transit_areas/03_hqta_map.ipynb
• high_quality_transit_areas/04_explore_whittier.ipynb
• high_quality_transit_areas/05_metro_brt.ipynb
• high_quality_transit_areas/06_muni_brt.ipynb
• high_quality_transit_areas/07_amtrak.ipynb
• high_quality_transit_areas/check1_downloads.ipynb
• high_quality_transit_areas/check2_hq_corridors.ipynb
• high_quality_transit_areas/check_exports.ipynb

[github-actions]

nbviewer URLs for impacted notebooks:

• high_quality_transit_areas/01_corridors-as-lines.ipynb
• high_quality_transit_areas/02_hqta_green_SACOG.ipynb
• high_quality_transit_areas/03_hqta_map.ipynb
• high_quality_transit_areas/04_explore_whittier.ipynb
• high_quality_transit_areas/05_metro_brt.ipynb
• high_quality_transit_areas/06_muni_brt.ipynb
• high_quality_transit_areas/07_amtrak.ipynb
• high_quality_transit_areas/check1_downloads.ipynb
• high_quality_transit_areas/check2_hq_corridors.ipynb
• high_quality_transit_areas/check_exports.ipynb

[github-actions]

nbviewer URLs for impacted notebooks:

• high_quality_transit_areas/01_corridors-as-lines.ipynb
• high_quality_transit_areas/02_hqta_green_SACOG.ipynb
• high_quality_transit_areas/03_hqta_map.ipynb
• high_quality_transit_areas/04_explore_whittier.ipynb
• high_quality_transit_areas/05_metro_brt.ipynb
• high_quality_transit_areas/06_muni_brt.ipynb
• high_quality_transit_areas/07_amtrak.ipynb
• high_quality_transit_areas/check1_downloads.ipynb
• high_quality_transit_areas/check2_hq_corridors.ipynb
• high_quality_transit_areas/check_exports.ipynb

[github-actions]

nbviewer URLs for impacted notebooks:

• high_quality_transit_areas/01_corridors-as-lines.ipynb
• high_quality_transit_areas/02_hqta_green_SACOG.ipynb
• high_quality_transit_areas/03_hqta_map.ipynb
• high_quality_transit_areas/04_explore_whittier.ipynb
• high_quality_transit_areas/05_metro_brt.ipynb
• high_quality_transit_areas/06_muni_brt.ipynb
• high_quality_transit_areas/07_amtrak.ipynb
• high_quality_transit_areas/check1_downloads.ipynb
• high_quality_transit_areas/check2_hq_corridors.ipynb
• high_quality_transit_areas/check_exports.ipynb

[github-actions]

nbviewer URLs for impacted notebooks:

• high_quality_transit_areas/01_corridors-as-lines.ipynb
• high_quality_transit_areas/02_hqta_green_SACOG.ipynb
• high_quality_transit_areas/03_hqta_map.ipynb
• high_quality_transit_areas/04_explore_whittier.ipynb
• high_quality_transit_areas/05_metro_brt.ipynb
• high_quality_transit_areas/06_muni_brt.ipynb
• high_quality_transit_areas/07_amtrak.ipynb
• high_quality_transit_areas/check1_downloads.ipynb
• high_quality_transit_areas/check2_hq_corridors.ipynb
• high_quality_transit_areas/check_exports.ipynb