Epic - Transit Speed Maps Data Source Migration

[KatrinaMKaiser]

Epic Information - Transit Speed Maps Data Source Migration

Summary

• Goal: Refactor CA Transit Speed Maps site to use Segment Speeds table instead of bespoke data processing

Tasks and responsibilities:

Pipeline tasks:

• Incorporate dwell time to full speeds pipeline - done but needs to be re-run for full set of operators, dates @tiffanychu90
• Incorporate aggregation fix to full speeds pipeline - same as above
• Incorporate 1-km segments to full speeds pipeline - done but is not the version published
• Update and publish revised speeds Open Data, including metadata/documentation - @edasmalchi will try this
  • Eric needs ArcGIS Pro and enterprise GDB .sde file . Modify notebook that @tiffanychu90 uses, kept locally.

Data vis/reporting tasks: @edasmalchi

• Refactor speed maps site data ingestion
• Update speed maps site external-facing documentation (as appropriate)
• Update speed maps site internal-facing documentation/instructions so any analyst can re-run on a monthly cadence

Notes, misc:

• Is Research Request - Nearest neighbor comparison  #1162 still relevant after the aggregation patch?

Reviewers [Stakeholders]

1. @tiffanychu90

Issues

• 1. Research Request - Align segment_speeds pipeline scripts to use vp with dwell time #1183
• 2. Research Task - patch segment_calcs np.percentile #1184
• TBD

Deliverables

• Updated CA Transit Speeds data in warehouse
• Updated Speed Maps site
• Updated Speed Segments data on Open Data Portal
• Updated Speed Maps site documentation (external-facing and internal-facing)