Research Request - Align segment_speeds pipeline scripts to use vp with dwell time

[tiffanychu90]

Complete the below when receiving a research request, and continue to add to this issue as you receive additional details and produce deliverables. Be sure to also add the appropriate project-level label to this issue (eg gtfs-rt, DLA).

Research Question

Single sentence description: Move test scripts into the full pipeline with all the bells and whistles of documenting in gtfs_analytics_data.yml + programmatically moving through various stages of processing and transformations for all the types of segments.

• stop_segments, rt_stop_times, speedmap_segments, and later road_segments
  • ex: stop segments stage 2
• Follow-up to Add vp dwell time / pilot Big Blue Bus speeds post alignment #1180
• Epic - Daskify RT segment speeds #592

Detailed description:

• These are the scripts at play
• new_nearest_10 --> nearest_vp_to_stop: this should replace stage2 and overwrite files completely
• new_narrow_to_2 --> [ no existing script ]: this is a new stage and creates new files and should probably be saved as stage2b
• new_interpolate --> interpolate_stop_arrivals: this should replace stage3 and overwrite files completely
• quick_bbb_speeds --> stop_arrivals_to_speeds, average_segment_speeds: no changes here, this spins off as is into existing 2 scripts. changes would include better filtering for outliers.
• Take all this for a test spin for July 2024 date because there are no existing files. Backfill when all decisions are finalized.